00010000:02000000:3.1F:1782481671.312561:0:20702:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1F:1782481672.322204:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1:1782481673.345782:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1:1782481674.370206:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1:1782481675.393797:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1:1782481693.574254:0:7508:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1F:1782481694.597111:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481695.617949:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481696.641775:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1782481697.659356:0:7508:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481698.692449:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481699.715899:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481700.738011:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481701.762828:0:5793:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1:1782481704.320792:0:6596:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:02000000:0.1:1782481704.323525:0:6596:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:02000000:3.1:1782481721.691460:0:20702:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:00010000:0.0:1782487582.240055:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240065:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240136:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240142:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240148:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.240159:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa91:0x0]: returning size 0 00000004:00200000:0.0:1782487582.240162:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.240173:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240180:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240185:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240189:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240193:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240198:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7fe000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.240200:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240206:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240213:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.240215:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.240218:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240222:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850d43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240231:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240253:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240261:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240268:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.240272:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240279:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240289:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c4bb4000) 00010000:00010000:0.0:1782487582.240291:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.240295:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240302:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850d51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240332:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b850d3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1184 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240346:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1183 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.240353:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa91:0x0].0x0 (ffff9cb4b6109600) 00010000:00010000:0.0:1782487582.240356:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.240359:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f31600, rc 0) 00000100:00100000:0.0:1782487582.240392:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:2361:x1869066293737344:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 439us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.240400:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 992 00000100:00100000:0.0:1782487582.242884:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293738112 00000100:00100000:0.0:1782487582.242891:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293738112 00000100:00100000:0.0:1782487582.242919:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209663330238 time 7209663230238 state 0x1 ref 3 00000100:00100000:0.0:1782487582.242945:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209664434801 time 7209664334801 state 0x1 ref 3 00000100:00100000:0.0:1782487582.242961:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1185:293286:x1869066293738112:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.242990:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.243007:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850d66 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746e8 expref: 1185 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.243032:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa56:0x0].0x0 (ffff9cb4b6109300) 00010000:00010000:0.0:1782487582.243047:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.243097:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.243109:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.243129:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.243265:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006d3889b reply state 000000008b395423 transno 8589955561 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.243274:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.243327:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:293286:x1869066293738112:12345-192.168.202.21@tcp:36:touch.500 Request processed in 370us (519us total) trans 8589955561 rc 0/0 00000100:00100000:0.0:1782487582.243336:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25286 00010000:00010000:0.0:1782487582.244059:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244077:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244085:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244091:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.244095:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244102:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244115:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa56:0x0].0x0 (ffff9cb4c4bb4200) 00010000:00010000:0.0:1782487582.244118:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.244124:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244140:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850da5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.244286:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293738624 00000100:00100000:0.0:1782487582.244291:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293738624 00010000:00010000:0.0:1782487582.244312:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1183 pid: 213216 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.244343:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5726 00000100:00100000:0.0:1782487582.244353:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:2363:x1869066293738624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.244362:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.244369:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1183 pid: 213216 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244382:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1183 pid: 213216 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244398:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f31600/0x66475b4e8b850d5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746ef expref: 1183 pid: 213216 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244411:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa91:0x0].0x0 (ffff9cb4b6109600) 00010000:00010000:0.0:1782487582.244416:0:190283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b850d89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xa91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244424:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b850d89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244431:0:190283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b850d89 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xa91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.244453:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.244485:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1182:2363:x1869066293738624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 133us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.244493:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5726 00010000:00010000:0.0:1782487582.247680:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247691:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247699:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247706:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fd200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.247711:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247720:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247733:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb5588ee500) 00010000:00010000:0.0:1782487582.247737:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.247740:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247751:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fd200/0x66475b4e8b850d82 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.247794:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209668473102 time 7209669183028 state 0x0 ref 2 00000100:00100000:0.0:1782487582.247809:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+872:293263:x1869066293739520:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.247840:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.247861:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c12200/0x66475b4e8b850849 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474536 expref: 872 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247883:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b850627 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xa95:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4744bf expref: 871 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247903:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa95:0x0].0x0 (ffff9cb5588eef00) 00010000:00010000:0.0:1782487582.247916:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.247930:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247948:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247957:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247976:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247989:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.247999:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248090:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248101:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248111:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.248523:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2391, 64 off161216 00010000:00010000:0.0:1782487582.248589:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248599:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248671:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248681:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248689:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248695:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248712:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.248726:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248733:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248740:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248746:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.248750:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248757:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248767:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa95:0x0].0x0 (ffff9cb4c4bb4300) 00010000:00010000:0.0:1782487582.248770:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.248774:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248781:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b850e07 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xa95:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248798:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248805:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248812:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248821:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.248825:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248833:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248842:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.248845:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.248849:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.248855:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30e00/0x66475b4e8b850df9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.248866:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8e5ab6f reply state 00000000b64299a8 transno 8589955566 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.248874:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.248925:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+872:293263:x1869066293739520:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1119us (2083us total) trans 8589955566 rc 0/0 00000100:00100000:0.0:1782487582.248933:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25290 00000100:00100000:0.0:1782487582.248939:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209668473102 time 7209669183028 state 0x2 ref 0 00000100:00100000:0.0:1782487582.248972:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293739648 00000100:00100000:0.0:1782487582.248978:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293739648 00000100:00100000:0.0:1782487582.249023:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15235 00000100:00100000:0.0:1782487582.249034:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2362:x1869066293739648:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.249249:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+138:2362:x1869066293739648:12345-192.168.202.21@tcp:2:touch.500 Request processed in 206us (1629us total) trans 8589940359 rc 0/0 00000100:00100000:0.0:1782487582.249259:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15235 00010000:00010000:0.0:1782487582.249288:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.249294:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.249301:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.249306:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.249313:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.249324:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa95:0x0].0x0 (ffff9cb4c4bb4300) 00010000:00010000:0.0:1782487582.249327:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.249331:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.249337:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa95:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.249355:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.249358:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.249361:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.250575:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250585:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250602:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250637:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683cb000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.250641:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250649:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250663:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4b6109b00) 00010000:00010000:0.0:1782487582.250668:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.250671:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.250677:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850de4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251270:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251280:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251287:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251292:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.251294:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251299:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251316:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4c4bb4000) 00010000:00010000:0.0:1782487582.251319:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.251322:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.251326:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b850e00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252260:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252271:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252277:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252291:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.252295:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252310:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252321:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa57:0x0].0x0 (ffff9cb54f03df00) 00010000:00010000:0.0:1782487582.252324:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.252327:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.252332:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b850e15 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.252441:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293740416 00000100:00100000:0.0:1782487582.252446:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293740416 00000100:00100000:0.0:1782487582.252479:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5430 00000100:00100000:0.0:1782487582.252495:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1185:293286:x1869066293740416:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.252800:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1186:293286:x1869066293740416:12345-192.168.202.21@tcp:35:touch.500 Request processed in 313us (402us total) trans 8589955568 rc 0/0 00000100:00100000:0.0:1782487582.252807:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5430 00000100:00100000:0.0:1782487582.257297:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293740544 00000100:00100000:0.0:1782487582.257304:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293740544 00000100:00100000:0.0:1782487582.257334:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209672207116 time 7209673485666 state 0x0 ref 1 00000100:00100000:0.0:1782487582.257347:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209673585666 time 7209673485666 state 0x1 ref 1 00000100:00100000:0.0:1782487582.257371:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293740672 00000100:00100000:0.0:1782487582.257373:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293740672 00000100:00100000:0.0:1782487582.257394:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209673585666 time 7209673485666 state 0x1 ref 2 00000100:00100000:0.0:1782487582.257421:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209678910935 time 7209678810935 state 0x1 ref 2 00000100:00100000:0.0:1782487582.257436:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1187:293295:x1869066293740544:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.257467:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.257494:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c12200/0x66475b4e8b850e3f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474719 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257530:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c12200/0x66475b4e8b850e3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474719 expref: 1189 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257552:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c12200/0x66475b4e8b850e3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474719 expref: 1189 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257576:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa57:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:0.0:1782487582.257582:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.257584:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a2c12200, rc 0) 00000100:00100000:0.0:1782487582.257665:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1189:293295:x1869066293740544:12345-192.168.202.21@tcp:101:touch.500 Request processed in 233us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.257675:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25293 00010000:00010000:0.0:1782487582.257847:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257858:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257865:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257885:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.257890:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257910:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257926:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb5588eeb00) 00010000:00010000:0.0:1782487582.257932:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.257938:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.257957:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b850e23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.260275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.260308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.260366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.260409:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293741056 00000100:00100000:0.0:1782487582.260415:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293741056 00000100:00100000:0.0:1782487582.260451:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293741312 00000100:00100000:0.0:1782487582.260456:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293741312 00000100:00100000:0.0:1782487582.260482:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15236 00000100:00100000:0.0:1782487582.260503:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2360:x1869066293741056:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.260776:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2360:x1869066293741056:12345-192.168.202.21@tcp:2:touch.500 Request processed in 273us (501us total) trans 8589939663 rc 0/0 00000100:00100000:0.0:1782487582.260785:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15236 00000100:00100000:0.0:1782487582.260806:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15237 00000100:00100000:0.0:1782487582.260815:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2360:x1869066293741312:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.260823:0:213221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.260838:0:213221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47472e expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.260856:0:213221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17ba:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.260870:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.260876:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.260884:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 151 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.260900:0:213221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 151 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.260912:0:213221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30e00, rc 0) 00000100:00100000:0.0:1782487582.260936:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2360:x1869066293741312:12345-192.168.202.21@tcp:101:rm.500 Request processed in 123us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.260943:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15237 00010000:00010000:0.0:1782487582.261587:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261597:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261623:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261631:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.261635:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261641:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261651:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5588eee00) 00010000:00010000:0.0:1782487582.261654:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.261658:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.261671:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b850e62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.264041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.264115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.265115:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.265194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.265234:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265253:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265261:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265277:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.265285:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265296:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265309:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4b6109000) 00010000:00010000:0.0:1782487582.265315:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.265320:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.265328:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850e85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.266187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.266220:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293742464 00000100:00100000:0.0:1782487582.266243:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293742464 00010000:00010000:0.0:1782487582.266269:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746b7 expref: 1194 pid: 213491 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.266301:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5727 00000100:00100000:0.0:1782487582.266316:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1194:2361:x1869066293742464:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.266333:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.266339:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746b7 expref: 1194 pid: 213491 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266358:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746b7 expref: 1194 pid: 213491 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266376:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850bf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746b7 expref: 1194 pid: 213491 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266394:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa8e:0x0].0x0 (ffff9cb57fc6b800) 00010000:00010000:0.0:1782487582.266401:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34000/0x66475b4e8b850eaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266412:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34000/0x66475b4e8b850eaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266419:0:192528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34000/0x66475b4e8b850eaf lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xa8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266446:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.266476:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1193:2361:x1869066293742464:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.266503:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5727 00010000:00010000:0.0:1782487582.266878:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266887:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266894:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266900:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.266905:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266912:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266924:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa58:0x0].0x0 (ffff9cb5588eef00) 00010000:00010000:0.0:1782487582.266927:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.266930:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.266936:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b850eb6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.267680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.269644:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293742976 00000100:00100000:0.0:1782487582.269651:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293742976 00000100:00100000:0.0:1782487582.269698:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15238 00000100:00100000:0.0:1782487582.269710:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+138:2362:x1869066293742976:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.269721:0:190931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.269750:0:190931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47474a expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.269774:0:190931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17e1:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.269789:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.269794:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.269803:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 139 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.269820:0:190931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 139 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.269831:0:190931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f31600, rc 0) 00000100:00100000:0.0:1782487582.269876:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+139:2362:x1869066293742976:12345-192.168.202.21@tcp:101:rm.500 Request processed in 169us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.269890:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15238 00010000:00010000:0.0:1782487582.271374:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271384:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271390:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271395:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.271398:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271402:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271411:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4b6109600) 00010000:00010000:0.0:1782487582.271413:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.271415:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271419:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850ea8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.271481:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293743488 00000100:00100000:0.0:1782487582.271485:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293743488 00000100:00100000:0.0:1782487582.271501:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209689443975 time 7209691071713 state 0x0 ref 1 00000100:00100000:0.0:1782487582.271508:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209691171713 time 7209691071713 state 0x1 ref 1 00000100:00100000:0.0:1782487582.271525:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209691171713 time 7209692916842 state 0x0 ref 1 00000100:00100000:0.0:1782487582.271533:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+867:293258:x1869066293743488:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.271570:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.271584:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85090d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa94:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47457c expref: 867 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271600:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b8505e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xa94:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4744b1 expref: 866 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271642:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa94:0x0].0x0 (ffff9cb45539c300) 00010000:00010000:0.0:1782487582.271655:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.271670:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271688:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271697:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271708:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271713:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271719:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271804:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271810:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.271815:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.272262:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2397, 64 off161600 00010000:00010000:0.0:1782487582.272324:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272331:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272337:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272343:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272348:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272352:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa94:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272368:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.272379:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272388:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272397:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272401:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.272404:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272418:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272429:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa94:0x0].0x0 (ffff9cb4c4bb4e00) 00010000:00010000:0.0:1782487582.272433:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.272436:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272442:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f1f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xa94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272453:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272457:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272461:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272466:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.272469:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272473:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272480:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.272482:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.272484:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272488:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.272499:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026ca8ad0 reply state 00000000686b06e2 transno 8589955576 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.272506:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.272542:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+867:293258:x1869066293743488:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1009us (1098us total) trans 8589955576 rc 0/0 00000100:00100000:0.0:1782487582.272553:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25302 00000100:00100000:0.0:1782487582.272560:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209691171713 time 7209692916842 state 0x2 ref 0 00000100:00100000:0.0:1782487582.272591:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 994 00000100:00100000:0.0:1782487582.272602:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+867:2360:x1869066293743232:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.272636:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.272645:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850f2d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474751 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272677:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272687:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272699:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272710:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272716:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272722:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272751:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272762:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272770:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272782:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.272786:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272802:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272811:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.272815:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.272821:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272832:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b850f34 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272848:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272854:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272862:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272868:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683cac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.272872:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272879:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272889:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x4fde95a8 (ffff9cb4c4bb4f00) 00010000:00010000:0.0:1782487582.272892:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.272895:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272901:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b850f3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272926:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850f2d lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474751 expref: 868 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272936:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.272938:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.272943:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b850f2d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474751 expref: 868 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.272954:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683cb000, rc -2) 00000100:00100000:0.0:1782487582.272990:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+867:2360:x1869066293743232:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 391us (611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.272999:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 994 00000100:00100000:0.0:1782487582.273297:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209693016842 time 7209694685465 state 0x0 ref 1 00000100:00100000:0.0:1782487582.273314:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1195:293297:x1869066293744000:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.273341:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.273355:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b850f03 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474743 expref: 1195 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.273368:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa59:0x0].0x0 (ffff9cb5588ee500) 00010000:00010000:0.0:1782487582.273377:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.273421:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b850f49 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.273428:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b850f49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.273434:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b850f49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.273515:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000436fd9eb reply state 00000000a4a532a9 transno 8589955577 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b850f49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.273521:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.273700:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1197:293297:x1869066293744000:12345-192.168.202.21@tcp:36:touch.500 Request processed in 390us (586us total) trans 8589955577 rc 0/0 00000100:00100000:0.0:1782487582.273708:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25303 00010000:00010000:0.0:1782487582.274289:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274299:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274303:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274307:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.274310:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274314:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274323:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4c4bb4400) 00010000:00010000:0.0:1782487582.274324:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.274327:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.274331:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b850f18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.276790:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293744640 00000100:00100000:0.0:1782487582.276796:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293744640 00000100:00100000:0.0:1782487582.276841:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 995 00000100:00100000:0.0:1782487582.276855:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+866:2362:x1869066293744640:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.276906:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.276923:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47475f expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.276960:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.276971:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.276988:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277003:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277014:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277032:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277096:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277105:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277110:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277118:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.277122:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277129:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277147:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.277151:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.277153:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277161:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850f73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277173:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277183:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277192:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277200:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.277204:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277210:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277228:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8ef95a8 (ffff9cb4c4bb4600) 00010000:00010000:0.0:1782487582.277232:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.277246:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277253:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850f7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277292:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f6c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47475f expref: 866 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277308:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.277311:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.277319:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b850f6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47475f expref: 866 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277347:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30000, rc -2) 00000100:00100000:0.0:1782487582.277391:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+865:2362:x1869066293744640:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 540us (632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.277404:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 995 00000100:00100000:0.0:1782487582.277437:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209698926877 time 7209698826877 state 0x1 ref 4 00000100:00100000:0.0:1782487582.277457:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1200:293301:x1869066293745024:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.277471:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.277481:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b850f9d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47476d expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277562:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277576:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277587:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277604:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277626:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.277631:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.278161:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17e3:0x0], index 0: 0 00010000:00010000:0.0:1782487582.278348:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b850fb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278358:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b850fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278367:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b850fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278397:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278404:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278411:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278417:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.278422:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278430:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278438:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.278440:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.278443:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278447:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b850fa4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.278457:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a4047fd reply state 0000000087e0e2c0 transno 8589955580 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.278466:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.278490:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b850f9d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47476d expref: 1202 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278507:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b850fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47476d expref: 1201 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.278514:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5b:0x0].0x0 (ffff9cb4c4bb4700) 00010000:00010000:0.0:1782487582.278517:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.278520:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb55647f400, rc 0) 00000100:00100000:0.0:1782487582.278559:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1202:293301:x1869066293745024:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1106us (1711us total) trans 8589955580 rc 0/0 00000100:00100000:0.0:1782487582.278568:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25307 00000100:00100000:0.0:1782487582.280513:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293745408 00000100:00100000:0.0:1782487582.280520:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293745408 00000100:00100000:0.0:1782487582.280575:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15240 00000100:00100000:0.0:1782487582.280589:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2363:x1869066293745408:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.280858:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2363:x1869066293745408:12345-192.168.202.21@tcp:2:touch.500 Request processed in 270us (390us total) trans 8589939664 rc 0/0 00000100:00100000:0.0:1782487582.280867:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15240 00010000:00010000:0.0:1782487582.280899:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280911:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280918:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280924:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.280928:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280936:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280948:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4c4bb4d00) 00010000:00010000:0.0:1782487582.280952:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.280956:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.280962:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b850fab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.281159:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209702619524 time 7209702547691 state 0x0 ref 4 00000100:00100000:0.0:1782487582.281177:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1201:293298:x1869066293745920:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.281206:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.281246:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b850e54 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474720 expref: 1200 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281270:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b850d74 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746f6 expref: 1199 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281283:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa55:0x0].0x0 (ffff9cb54f03db00) 00010000:00010000:0.0:1782487582.281298:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.281315:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281335:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281343:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281355:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281371:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281391:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281479:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281500:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.281518:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.282357:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2392, 64 off161280 00010000:00010000:0.0:1782487582.282422:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282430:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282436:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282441:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282446:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282449:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b850fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282469:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.282477:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282485:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282489:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282493:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb55647ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.282495:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282499:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282506:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa55:0x0].0x0 (ffff9cb4c4bb4f00) 00010000:00010000:0.0:1782487582.282508:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.282510:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282515:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647ec00/0x66475b4e8b850fdc lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282525:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282529:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282533:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282537:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb55647f800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.282541:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282795:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282803:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.282805:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.282808:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.282814:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f800/0x66475b4e8b850fce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.282826:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb188f19 reply state 00000000f63dd4a4 transno 8589955584 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.282834:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.282871:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1202:293298:x1869066293745920:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1699us (1859us total) trans 8589955584 rc 0/0 00000100:00100000:0.0:1782487582.282880:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25310 00000100:00100000:0.0:1782487582.282886:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209702619524 time 7209702547691 state 0x2 ref 0 00000100:00100000:0.0:1782487582.283320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.283361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.283392:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293746048 00000100:00100000:0.0:1782487582.283398:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293746048 00000100:00100000:0.0:1782487582.283419:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209702619524 time 7209702547691 state 0x0 ref 1 00000100:00100000:0.0:1782487582.283428:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209702647691 time 7209702547691 state 0x1 ref 1 00000100:00100000:0.0:1782487582.283447:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209702647691 time 7209704837572 state 0x0 ref 1 00000100:00100000:0.0:1782487582.283460:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57b518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1203:293301:x1869066293746048:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.283479:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.283494:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850fea lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474774 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.283529:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850fea lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474774 expref: 1203 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.283542:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850fea lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474774 expref: 1203 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.283559:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5b:0x0].0x0 (ffff9cb4c4bb4600) 00010000:00010000:0.0:1782487582.283562:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.283566:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56da25600, rc 0) 00000100:00100000:0.0:1782487582.283591:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57b518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1203:293301:x1869066293746048:12345-192.168.202.21@tcp:101:touch.500 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.283599:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25311 00000100:00100000:0.0:1782487582.283604:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209702647691 time 7209704837572 state 0x2 ref 0 00010000:00010000:0.0:1782487582.283954:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.283970:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.283988:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284007:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb55647fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.284022:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284032:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284044:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c4bb4400) 00010000:00010000:0.0:1782487582.284048:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.284052:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284059:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647fe00/0x66475b4e8b850fd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284081:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284089:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284096:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284102:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d34800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.284105:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284110:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284121:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb5588ee600) 00010000:00010000:0.0:1782487582.284124:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.284126:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.284131:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d34800/0x66475b4e8b850f88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.285721:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293746688 00000100:00100000:0.0:1782487582.285727:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293746688 00000100:00100000:0.0:1782487582.285747:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209706463797 time 7209706363797 state 0x1 ref 2 00000100:00100000:0.0:1782487582.285768:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293747072 00000100:00100000:0.0:1782487582.285771:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293747072 00000100:00100000:0.0:1782487582.285787:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209707266609 time 7209707166609 state 0x1 ref 3 00000100:00100000:0.0:1782487582.285825:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209707266609 time 7209707214715 state 0x0 ref 3 00000100:00100000:0.0:1782487582.286004:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1202:293302:x1869066293747072:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:0.0:1782487582.286033:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293746816 00000100:00100000:0.0:1782487582.286037:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293746816 00000100:00100000:0.0:1782487582.286075:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15241 00000100:00100000:0.0:1782487582.286085:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+140:2361:x1869066293746816:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.286315:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2361:x1869066293746816:12345-192.168.202.21@tcp:2:touch.500 Request processed in 232us (371us total) trans 8589940361 rc 0/0 00000100:00100000:0.0:1782487582.286324:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15241 00010000:00010000:0.0:1782487582.286401:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.286413:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b851014 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474782 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286490:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286499:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286508:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286520:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286528:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.286536:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.286957:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17bd:0x0], index 1: 0 00010000:00010000:0.0:1782487582.287086:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b851029 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287096:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b851029 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287105:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b851029 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287130:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287135:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287139:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287143:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.287146:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287150:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287157:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.287159:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.287161:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287166:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391a00/0x66475b4e8b85101b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.287174:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001517c068 reply state 00000000951a3a59 transno 8589955587 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.287178:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.287196:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b851014 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474782 expref: 1205 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287206:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cb000/0x66475b4e8b851029 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474782 expref: 1204 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.287215:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5c:0x0].0x0 (ffff9cb4c4bb4e00) 00010000:00010000:0.0:1782487582.287217:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.287219:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683cb000, rc 0) 00000100:00100000:0.0:1782487582.287270:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1205:293302:x1869066293747072:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1434us (1531us total) trans 8589955587 rc 0/0 00000100:00100000:0.0:1782487582.287279:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25314 00000100:00100000:0.0:1782487582.287285:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209707266609 time 7209707214715 state 0x2 ref 0 00010000:00010000:0.0:1782487582.288583:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288592:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288599:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288626:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.288630:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288638:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288710:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4b6109b00) 00010000:00010000:0.0:1782487582.288714:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.288718:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.288728:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b850ff8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290022:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290031:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290038:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290044:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.290048:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290055:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290066:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4c4bb4800) 00010000:00010000:0.0:1782487582.290069:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.290073:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290079:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851022 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.290110:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293747712 00000100:00100000:0.0:1782487582.290114:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293747712 00000100:00100000:0.0:1782487582.290194:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209707266609 time 7209707214715 state 0x0 ref 1 00000100:00100000:0.0:1782487582.290208:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209707314715 time 7209707214715 state 0x1 ref 1 00000100:00100000:0.0:1782487582.290243:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209707314715 time 7209711625072 state 0x0 ref 1 00000100:00100000:0.0:1782487582.290255:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+863:293268:x1869066293747712:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.290297:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782487582.290315:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b850a02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4745de expref: 863 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290335:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85095a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474591 expref: 862 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290352:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8506eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xa97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4744e9 expref: 861 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290365:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa97:0x0].0x0 (ffff9cb5588ee700) 00010000:00010000:0.0:1782487582.290376:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.290392:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290405:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290414:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290429:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b85103e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290441:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b85103e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290449:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b85103e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290541:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290550:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.290559:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.291050:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2393, 64 off161344 00010000:00010000:0.0:1782487582.291120:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291242:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291253:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291261:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291267:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291272:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85104c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa97:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291296:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.291311:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291317:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291324:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291330:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.291335:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291341:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291350:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa97:0x0].0x0 (ffff9cb4c4bb4d00) 00010000:00010000:0.0:1782487582.291353:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.291357:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291363:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851045 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xa97:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291379:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291386:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.291396:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.292088:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683cac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.292093:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.292100:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.292112:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.292117:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.292123:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.292186:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b851037 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.292200:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021a1e966 reply state 00000000424e2e42 transno 8589955589 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b85103e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.292207:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.292259:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+862:293268:x1869066293747712:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2007us (2285us total) trans 8589955589 rc 0/0 00000100:00100000:0.0:1782487582.292270:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25315 00010000:00010000:0.0:1782487582.295621:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295633:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295645:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295652:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.295656:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295664:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295676:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.295679:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.295683:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295690:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9c00/0x66475b4e8b85106f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295712:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295719:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295727:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295733:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.295737:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295748:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295759:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5c:0x0].0x0 (ffff9cb5588eed00) 00010000:00010000:0.0:1782487582.295762:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.295766:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.295773:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9800/0x66475b4e8b851053 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.296171:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293748864 00000100:00100000:0.0:1782487582.296179:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293748864 00000100:00100000:0.0:1782487582.296213:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209713318008 time 7209713528893 state 0x0 ref 1 00000100:00100000:0.0:1782487582.296245:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209713628893 time 7209713528893 state 0x1 ref 2 00000100:00100000:0.0:1782487582.296321:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209717806698 time 7209717706698 state 0x1 ref 2 00000100:00100000:0.0:1782487582.296337:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1210:293302:x1869066293748608:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.296362:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.296381:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b851084 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474790 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.296434:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b851084 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474790 expref: 1211 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.296450:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b851084 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474790 expref: 1211 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.296489:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5c:0x0].0x0 (ffff9cb4c4bb4800) 00010000:00010000:0.0:1782487582.296494:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.296497:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558499400, rc 0) 00000100:00100000:0.0:1782487582.296646:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1210:293302:x1869066293748608:12345-192.168.202.21@tcp:101:touch.500 Request processed in 312us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.296656:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25318 00000100:00100000:0.0:1782487582.296683:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209717855238 time 7209718073121 state 0x0 ref 2 00000100:00100000:0.0:1782487582.296695:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1210:293306:x1869066293748992:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.296703:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.296714:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851092 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474797 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.296819:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.296830:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297304:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297323:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297332:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297344:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297447:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297457:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297466:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.297488:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xa57:0x0]: returning size 0 00000004:00200000:0.0:1782487582.297493:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.297507:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297518:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297526:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297533:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297540:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297941:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.297945:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297953:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297964:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.297968:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.297972:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297978:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851099 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297990:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.297996:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298002:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298007:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.298011:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298017:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298025:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4c4bb4e00) 00010000:00010000:0.0:1782487582.298028:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.298031:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298037:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298066:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851092 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474797 expref: 1212 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298078:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8510a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474797 expref: 1211 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.298086:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa57:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:0.0:1782487582.298088:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.298091:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558499c00, rc 0) 00000100:00100000:0.0:1782487582.298134:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1211:293306:x1869066293748992:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1441us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.298143:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25320 00000100:00100000:0.0:1782487582.298149:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209717855238 time 7209718073121 state 0x2 ref 0 00000100:00100000:0.0:1782487582.299714:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293749120 00000100:00100000:0.0:1782487582.299722:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293749120 00000100:00100000:0.0:1782487582.299826:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293749376 00000100:00100000:0.0:1782487582.299834:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293749376 00000100:00100000:0.0:1782487582.299862:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15243 00000100:00100000:0.0:1782487582.299870:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+153:2360:x1869066293749120:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.300153:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2360:x1869066293749120:12345-192.168.202.21@tcp:2:touch.500 Request processed in 281us (484us total) trans 8589939665 rc 0/0 00000100:00100000:0.0:1782487582.300161:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15243 00000100:00100000:0.0:1782487582.300184:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15244 00000100:00100000:0.0:1782487582.300194:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+153:2360:x1869066293749376:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.300202:0:213226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.300219:0:213226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4747a5 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.300821:0:213226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17bb:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.300838:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.300843:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.300853:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 154 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.300869:0:213226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 154 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.300879:0:213226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683cb000, rc 0) 00000100:00100000:0.0:1782487582.300904:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2360:x1869066293749376:12345-192.168.202.21@tcp:101:rm.500 Request processed in 712us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.300912:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15244 00000100:00100000:0.0:1782487582.303159:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293749632 00000100:00100000:0.0:1782487582.303168:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293749632 00000100:00100000:0.0:1782487582.303199:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209718173121 time 7209721875985 state 0x0 ref 1 00000100:00100000:0.0:1782487582.303210:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209721975985 time 7209721875985 state 0x1 ref 1 00000100:00100000:0.0:1782487582.303251:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209721975985 time 7209724626860 state 0x0 ref 1 00000100:00100000:0.0:1782487582.303269:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1211:293304:x1869066293749632:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.303320:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.303345:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe000/0x66475b4e8b850ed2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474735 expref: 1211 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303376:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b850dcf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47470b expref: 1210 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303390:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa56:0x0].0x0 (ffff9cb54f03dc00) 00010000:00010000:0.0:1782487582.303401:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.303424:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303435:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303445:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303460:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303467:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303474:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303632:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303642:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.303650:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.304785:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2400, 64 off161792 00010000:00010000:0.0:1782487582.304882:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304891:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304897:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304903:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304908:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304912:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304929:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.304944:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304948:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304955:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304960:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.304964:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304973:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304982:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa56:0x0].0x0 (ffff9cb4c4bb4400) 00010000:00010000:0.0:1782487582.304986:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.304989:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.304998:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b8510ca lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305014:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305029:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305034:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305039:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683cac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.305043:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305052:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305069:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.305074:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.305077:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.305081:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.305090:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e8e32c3 reply state 000000003d99fd89 transno 8589955594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.305098:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.305157:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1211:293304:x1869066293749632:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1892us (2049us total) trans 8589955594 rc 0/0 00000100:00100000:0.0:1782487582.305164:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25322 00000100:00100000:0.0:1782487582.305169:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209721975985 time 7209724626860 state 0x2 ref 0 00010000:00010000:0.0:1782487582.307714:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307722:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307738:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307742:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.307747:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307753:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307768:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4bb4700) 00010000:00010000:0.0:1782487582.307773:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.307776:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.307780:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8510c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.309181:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293750272 00000100:00100000:0.0:1782487582.309187:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293750272 00000100:00100000:0.0:1782487582.309212:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209721975985 time 7209724626860 state 0x0 ref 1 00000100:00100000:0.0:1782487582.309224:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209724726860 time 7209724626860 state 0x1 ref 1 00000100:00100000:0.0:1782487582.309271:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209724726860 time 7209730660300 state 0x0 ref 1 00000100:00100000:0.0:1782487582.309284:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1211:293310:x1869066293750272:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.309297:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.309313:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4747ac expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309424:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309437:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309448:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309463:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309470:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.309478:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.309956:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17be:0x0], index 1: 0 00010000:00010000:0.0:1782487582.310144:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510ed lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310155:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310164:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310198:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310205:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310211:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310221:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.310226:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310233:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310399:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.310402:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.310407:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310413:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8510df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.310427:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036aa34c9 reply state 00000000a43969ee transno 8589955596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8510e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.310437:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.310464:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8510d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747ac expref: 1214 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310479:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683cac00/0x66475b4e8b8510ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747ac expref: 1213 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.310486:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5e:0x0].0x0 (ffff9cb4c4bb4400) 00010000:00010000:0.0:1782487582.310489:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.310493:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683cac00, rc 0) 00000100:00100000:0.0:1782487582.310628:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1215:293310:x1869066293750272:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1323us (2232us total) trans 8589955596 rc 0/0 00000100:00100000:0.0:1782487582.310643:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25323 00000100:00100000:0.0:1782487582.310654:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209724726860 time 7209730660300 state 0x2 ref 0 00000100:00100000:0.0:1782487582.313060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.314304:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314312:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314316:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314321:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.314324:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314330:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314339:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5e:0x0].0x0 (ffff9cb5588eed00) 00010000:00010000:0.0:1782487582.314341:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.314343:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.314348:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8510fb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.314502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.315447:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293751168 00000100:00100000:0.0:1782487582.315452:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293751168 00000100:00100000:0.0:1782487582.315467:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209734724010 time 7209736186314 state 0x0 ref 1 00000100:00100000:0.0:1782487582.315474:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209736286314 time 7209736186314 state 0x1 ref 1 00000100:00100000:0.0:1782487582.315511:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209736286314 time 7209736902497 state 0x0 ref 1 00000100:00100000:0.0:1782487582.315520:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1215:293317:x1869066293751168:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.315528:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.315536:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b851109 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4747ba expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315652:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315664:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315673:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315689:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851117 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315696:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.315702:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.316144:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17e5:0x0], index 0: 0 00000100:00100000:0.0:1782487582.316174:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293751296 00000100:00100000:0.0:1782487582.316177:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293751296 00000100:00100000:0.0:1782487582.316211:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15246 00000100:00100000:0.0:1782487582.316218:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2362:x1869066293751296:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.316455:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+155:2362:x1869066293751296:12345-192.168.202.21@tcp:2:touch.500 Request processed in 236us (313us total) trans 8589939666 rc 0/0 00000100:00100000:0.0:1782487582.316463:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15246 00010000:00010000:0.0:1782487582.316658:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b85111e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316669:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b85111e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316677:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b85111e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316712:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316718:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316725:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316731:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.316736:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316744:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316757:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.316760:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.316765:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316771:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851110 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.316784:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e7751a reply state 0000000038188de5 transno 8589955599 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.316792:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.316820:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b851109 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747ba expref: 1218 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316836:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8ce00/0x66475b4e8b85111e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747ba expref: 1217 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.316843:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb548f15900) 00010000:00010000:0.0:1782487582.316846:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.316849:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8ce00, rc 0) 00000100:00100000:0.0:1782487582.316890:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1218:293317:x1869066293751168:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1370us (1503us total) trans 8589955599 rc 0/0 00000100:00100000:0.0:1782487582.316899:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25326 00000100:00100000:0.0:1782487582.316905:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209736286314 time 7209736902497 state 0x2 ref 0 00000100:00100000:0.0:1782487582.317458:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.318872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.318900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.319015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.319038:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293751680 00000100:00100000:0.0:1782487582.319042:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293751680 00000100:00100000:0.0:1782487582.319067:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209736286314 time 7209736902497 state 0x0 ref 1 00000100:00100000:0.0:1782487582.319079:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209737002497 time 7209736902497 state 0x1 ref 1 00000100:00100000:0.0:1782487582.319104:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293751936 00000100:00100000:0.0:1782487582.319108:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293751936 00000100:00100000:0.0:1782487582.319125:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209737002497 time 7209736902497 state 0x1 ref 2 00000100:00100000:0.0:1782487582.319154:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209740642871 time 7209740542871 state 0x1 ref 3 00000100:00100000:0.0:1782487582.319169:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:293313:x1869066293751680:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.319188:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.319201:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85112c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4747c1 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319250:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319272:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319282:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319299:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319309:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319317:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319414:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319425:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319435:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.319461:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xa58:0x0]: returning size 0 00000004:00200000:0.0:1782487582.319468:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.319483:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319494:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319502:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319510:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319517:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319527:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.319533:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319544:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319563:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.319567:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.319571:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319578:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851133 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319595:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319644:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319655:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319674:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.319680:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319694:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319740:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb57fc6b800) 00010000:00010000:0.0:1782487582.319747:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.319751:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319756:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85113a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319784:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85112c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747c1 expref: 1223 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319807:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747c1 expref: 1222 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.319825:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa58:0x0].0x0 (ffff9cb4b6109100) 00010000:00010000:0.0:1782487582.319831:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.319836:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45f92dc00, rc 0) 00000100:00100000:0.0:1782487582.319881:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1222:293313:x1869066293751680:12345-192.168.202.21@tcp:101:rm.500 Request processed in 716us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.319889:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25327 00000100:00100000:0.0:1782487582.322222:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293752576 00000100:00100000:0.0:1782487582.322229:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293752576 00000100:00100000:0.0:1782487582.322282:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293752704 00000100:00100000:0.0:1782487582.322286:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293752704 00000100:00100000:0.0:1782487582.322321:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15248 00000100:00100000:0.0:1782487582.322339:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+155:2360:x1869066293752704:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.322352:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.322367:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47481c expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.322399:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17bc:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.322419:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.322427:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.322440:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 156 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.322472:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 156 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.322490:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976ee00, rc 0) 00000100:00100000:0.0:1782487582.322523:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+156:2360:x1869066293752704:12345-192.168.202.21@tcp:101:rm.500 Request processed in 189us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.322535:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15248 00000100:00100000:0.0:1782487582.322892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.324148:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324155:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324159:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324164:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.324167:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324173:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324182:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.324184:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.324187:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.324191:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b851180 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.326283:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293752960 00000100:00100000:0.0:1782487582.326289:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293752960 00000100:00100000:0.0:1782487582.326305:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293753088 00000100:00100000:0.0:1782487582.326307:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293753088 00000100:00100000:0.0:1782487582.326447:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15250 00000100:00100000:0.0:1782487582.326456:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+156:2362:x1869066293753088:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:0.0:1782487582.326470:0:190930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.326495:0:190930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474831 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.326518:0:190930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17be:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.326534:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.326549:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.326558:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 157 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.326574:0:190930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 157 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.326585:0:190930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976fa00, rc 0) 00000100:00100000:0.0:1782487582.326666:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+157:2362:x1869066293753088:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 211us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.326674:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15250 00000100:00100000:0.0:1782487582.326845:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209741696078 time 7209742656917 state 0x0 ref 1 00000100:00100000:0.0:1782487582.326855:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209742756917 time 7209742656917 state 0x1 ref 2 00000100:00100000:0.0:1782487582.326913:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209748403604 time 7209748303604 state 0x1 ref 2 00000100:00100000:0.0:1782487582.326924:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1223:293317:x1869066293752960:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.326936:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.326953:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b8511e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47482a expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327000:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b8511e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47482a expref: 1224 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327013:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b8511e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47482a expref: 1224 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327030:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb454b2a700) 00010000:00010000:0.0:1782487582.327034:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.327038:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45f92c000, rc 0) 00000100:00100000:0.0:1782487582.327066:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1224:293317:x1869066293752960:12345-192.168.202.21@tcp:101:touch.500 Request processed in 145us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.327072:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25332 00000100:00100000:0.0:1782487582.327088:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209748403604 time 7209748479872 state 0x0 ref 1 00000100:00100000:0.0:1782487582.327095:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1223:293313:x1869066293753344:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.327128:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.327145:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85114f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747c1 expref: 1223 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327166:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b850ee0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47473c expref: 1222 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327183:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa58:0x0].0x0 (ffff9cb4b6109100) 00010000:00010000:0.0:1782487582.327196:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.327212:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327224:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327248:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327264:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327272:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327280:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327416:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327426:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.327434:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.327981:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2401, 64 off161856 00010000:00010000:0.0:1782487582.328062:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328072:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328080:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328088:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328094:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328101:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328120:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.328141:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.328146:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328154:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.328158:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328165:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328175:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa58:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.328178:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.328182:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328187:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851205 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328199:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.328202:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.328205:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.328346:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328355:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328361:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328367:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.328371:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328382:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328392:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa58:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.328395:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.328398:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328405:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b8511fe lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328425:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328432:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328438:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328443:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.328447:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328454:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328465:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.328468:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.328471:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.328482:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8511f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.328494:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e53ec82 reply state 000000006d08694e transno 8589955602 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.328502:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.328552:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1223:293313:x1869066293753344:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1455us (2676us total) trans 8589955602 rc 0/0 00000100:00100000:0.0:1782487582.328561:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25333 00000100:00100000:0.0:1782487582.328567:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209748403604 time 7209748479872 state 0x2 ref 0 00010000:00010000:0.0:1782487582.330149:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330159:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330167:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330174:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.330178:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330187:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330201:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb454b2a600) 00010000:00010000:0.0:1782487582.330204:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.330209:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.330215:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b8511f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.339427:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293753984 00000100:00100000:0.0:1782487582.339437:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293753984 00000100:00100000:0.0:1782487582.339469:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209748579872 time 7209752044061 state 0x0 ref 1 00000100:00100000:0.0:1782487582.339483:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209752144061 time 7209752044061 state 0x1 ref 1 00000100:00100000:0.0:1782487582.339543:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209752144061 time 7209760931744 state 0x0 ref 1 00000100:00100000:0.0:1782487582.339557:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1224:293322:x1869066293753984:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.339625:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.339645:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b851221 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474838 expref: 1224 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.339660:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa60:0x0].0x0 (ffff9cb5588eee00) 00010000:00010000:0.0:1782487582.339670:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.339728:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85122f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.339741:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85122f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.339751:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85122f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.339885:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000879f03ca reply state 00000000fa1f77fe transno 8589955604 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85122f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.339896:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.339999:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:293322:x1869066293753984:12345-192.168.202.21@tcp:36:touch.500 Request processed in 443us (702us total) trans 8589955604 rc 0/0 00000100:00100000:0.0:1782487582.340009:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25335 00000100:00100000:0.0:1782487582.340015:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209752144061 time 7209760931744 state 0x2 ref 0 00000100:00100000:0.0:1782487582.340910:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293754496 00000100:00100000:0.0:1782487582.340916:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293754496 00000100:00100000:0.0:1782487582.340967:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5439 00000100:00100000:0.0:1782487582.340977:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:293317:x1869066293754496:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.341294:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:293317:x1869066293754496:12345-192.168.202.21@tcp:35:touch.500 Request processed in 316us (420us total) trans 8589955605 rc 0/0 00000100:00100000:0.0:1782487582.341312:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5439 00000040:00080000:0.0:1782487582.342088:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2394, 64 off161408 00010000:00010000:0.0:1782487582.342380:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342390:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342399:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342407:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342414:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342425:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85124b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342448:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.342462:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342469:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342476:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342492:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.342496:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342504:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342514:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa57:0x0].0x0 (ffff9cb4b6109b00) 00010000:00010000:0.0:1782487582.342518:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.342522:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342528:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851244 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342545:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342555:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342561:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342566:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.342570:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342577:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342586:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.342589:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.342593:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.342599:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b851236 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.342635:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ad6642a reply state 00000000087dbb1b transno 8589955606 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b85123d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.342644:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.342698:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:293306:x1869066293754240:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1567us (1982us total) trans 8589955606 rc 0/0 00000100:00100000:0.0:1782487582.342712:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25336 00000100:00100000:0.0:1782487582.342721:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209761031744 time 7209762507599 state 0x2 ref 0 00000100:00100000:0.0:1782487582.342814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.347488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.350134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.350204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.350625:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293755520 00000100:00100000:0.0:1782487582.350630:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293755520 00000100:00100000:0.0:1782487582.350653:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209771780486 time 7209771680486 state 0x1 ref 2 00000100:00100000:0.0:1782487582.350679:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209771780486 time 7209772067934 state 0x0 ref 2 00000100:00100000:0.0:1782487582.350700:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1229:293323:x1869066293755520:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.350713:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.350725:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b851283 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47484d expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350837:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350849:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350859:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350873:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851291 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350881:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.350894:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.351303:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17c0:0x0], index 1: 0 00010000:00010000:0.0:1782487582.351840:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851298 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351851:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351860:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351886:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351894:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351901:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351907:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.351912:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351920:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351930:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.351934:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.351938:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.351946:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85128a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.351957:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff64b2bd reply state 000000004fd79b9c transno 8589955609 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.351964:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.351986:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b851283 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47484d expref: 1231 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.352001:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47484d expref: 1230 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.352010:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa62:0x0].0x0 (ffff9cb4c9e2f100) 00010000:00010000:0.0:1782487582.352013:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.352015:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498a00, rc 0) 00000100:00100000:0.0:1782487582.352139:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1231:293323:x1869066293755520:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1441us (1934us total) trans 8589955609 rc 0/0 00000100:00100000:0.0:1782487582.352147:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25340 00000100:00100000:0.0:1782487582.352153:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209771780486 time 7209772067934 state 0x2 ref 0 00000100:00100000:0.0:1782487582.352491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.356221:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293756672 00000100:00100000:0.0:1782487582.356227:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293756672 00000100:00100000:0.0:1782487582.356337:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15253 00000100:00100000:0.0:1782487582.356348:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2361:x1869066293756672:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.356698:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2361:x1869066293756672:12345-192.168.202.21@tcp:2:touch.500 Request processed in 350us (511us total) trans 8589940365 rc 0/0 00000100:00100000:0.0:1782487582.356708:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15253 00000100:00100000:0.0:1782487582.359161:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293757696 00000100:00100000:0.0:1782487582.359168:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293757696 00000100:00100000:0.0:1782487582.359215:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 997 00000100:00100000:0.0:1782487582.359231:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560b41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2363:x1869066293757696:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.359271:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.359286:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8512de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47487e expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359341:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359356:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359437:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359461:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359471:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359480:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359640:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359649:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359657:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359664:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.359669:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359688:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359711:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.359718:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.359724:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359737:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b8512ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359752:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359767:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359774:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359781:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.359788:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359798:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359816:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x4fde95a8 (ffff9cb4c9e2f400) 00010000:00010000:0.0:1782487582.359821:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.359826:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359840:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851301 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x4fde95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359868:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8512de lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47487e expref: 1242 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359879:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.359883:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.359887:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499c00/0x66475b4e8b8512de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47487e expref: 1242 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.359900:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558499c00, rc -2) 00000100:00100000:0.0:1782487582.359936:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560b41050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1241:2363:x1869066293757696:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 709us (800us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.359946:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 997 00000100:00100000:0.0:1782487582.360068:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293757952 00000100:00100000:0.0:1782487582.360074:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293757952 00000100:00100000:0.0:1782487582.360111:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5441 00000100:00100000:0.0:1782487582.360122:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1242:293319:x1869066293757952:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.360331:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1242:293319:x1869066293757952:12345-192.168.202.21@tcp:35:touch.500 Request processed in 209us (1157us total) trans 8589955614 rc 0/0 00000100:00100000:0.0:1782487582.360348:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5441 00000100:00100000:0.0:1782487582.363095:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293758208 00000100:00100000:0.0:1782487582.363102:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293758208 00000100:00100000:0.0:1782487582.363124:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209781958540 time 7209782424477 state 0x0 ref 1 00000100:00100000:0.0:1782487582.363135:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209782524477 time 7209782424477 state 0x1 ref 1 00000100:00100000:0.0:1782487582.363163:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209782524477 time 7209784553454 state 0x0 ref 1 00000100:00100000:0.0:1782487582.363177:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1240:293318:x1869066293758208:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.363188:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.363202:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851386 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474893 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.363247:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474893 expref: 1241 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.363261:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851386 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474893 expref: 1241 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.363277:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa63:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:0.0:1782487582.363280:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.363283:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498200, rc 0) 00000100:00100000:0.0:1782487582.363318:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1241:293318:x1869066293758208:12345-192.168.202.21@tcp:101:touch.500 Request processed in 144us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.363330:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25351 00000100:00100000:0.0:1782487582.363335:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209782524477 time 7209784553454 state 0x2 ref 0 00000100:00100000:0.0:1782487582.363365:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293758336 00000100:00100000:0.0:1782487582.363369:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293758336 00000100:00100000:0.0:1782487582.363461:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1075 00000100:00100000:0.0:1782487582.363472:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1241:2360:x1869066293758336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.363481:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.363496:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b851347 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa5e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474877 expref: 1241 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.363511:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5e:0x0].0x0 (ffff9cb4b6109a00) 00010000:00010000:0.0:1782487582.363516:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.363553:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1241:2360:x1869066293758336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 83us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.363561:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1075 00000100:00100000:0.0:1782487582.366703:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15255 00000100:00100000:0.0:1782487582.366717:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+159:2361:x1869066293758720:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.366731:0:213221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.366748:0:213221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47489a expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.366772:0:213221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17bd:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.366788:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.366793:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.366802:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 160 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.366819:0:213221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 160 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.366833:0:213221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558499c00, rc 0) 00000100:00100000:0.0:1782487582.366878:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+160:2361:x1869066293758720:12345-192.168.202.21@tcp:101:rm.500 Request processed in 164us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.366894:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15255 00000100:00100000:0.0:1782487582.377923:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293760768 00000100:00100000:0.0:1782487582.377929:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293760768 00000100:00100000:0.0:1782487582.377969:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 998 00000100:00100000:0.0:1782487582.377980:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1243:2363:x1869066293760768:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.378003:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.378015:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85140b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4748c4 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378049:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378060:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378070:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378089:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378113:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378129:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378170:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378182:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378199:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378217:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.378223:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378254:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378276:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.378280:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.378287:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378302:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851412 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378326:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378336:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378355:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378369:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.378375:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378392:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378407:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4c9e2f200) 00010000:00010000:0.0:1782487582.378413:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.378416:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378431:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b851420 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378457:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85140b lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748c4 expref: 1245 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378468:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.378472:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.378477:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b85140b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748c4 expref: 1245 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.378499:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498a00, rc -2) 00000100:00100000:0.0:1782487582.378545:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1245:2363:x1869066293760768:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 568us (1644us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.378555:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 998 00010000:00010000:0.0:1782487582.380940:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.380952:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.380960:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.380967:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.380973:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.380981:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.380995:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb45539c300) 00010000:00010000:0.0:1782487582.380998:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.381002:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381009:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b8513fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.381428:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293761024 00000100:00100000:0.0:1782487582.381435:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293761024 00000100:00100000:0.0:1782487582.381463:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209796331869 time 7209798397071 state 0x0 ref 1 00000100:00100000:0.0:1782487582.381475:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209798497071 time 7209798397071 state 0x1 ref 1 00000100:00100000:0.0:1782487582.381508:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209798497071 time 7209802896902 state 0x0 ref 1 00000100:00100000:0.0:1782487582.381523:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1243:293321:x1869066293761024:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.381540:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.381556:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1600/0x66475b4e8b851427 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4748e0 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381631:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381643:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381653:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381668:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381680:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381689:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381768:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381777:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381783:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381788:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.381792:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381798:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381808:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.381811:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.381815:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381822:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343a00/0x66475b4e8b85142e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381833:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381840:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381846:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381852:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456342e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.381856:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381862:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381871:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c9e2f800) 00010000:00010000:0.0:1782487582.381875:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.381879:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381885:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b851435 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381918:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1600/0x66475b4e8b851427 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748e0 expref: 1246 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381930:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.381933:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.381937:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1600/0x66475b4e8b851427 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748e0 expref: 1246 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.381950:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1600, rc 0) 00000100:00100000:0.0:1782487582.381995:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1245:293321:x1869066293761024:12345-192.168.202.21@tcp:101:rm.500 Request processed in 476us (730us total) trans 0 rc 301/301 00000100:00100000:0.0:1782487582.382002:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25357 00000100:00100000:0.0:1782487582.382008:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209798497071 time 7209802896902 state 0x2 ref 0 00000100:00100000:0.0:1782487582.383118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.383709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.383742:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293761664 00000100:00100000:0.0:1782487582.383748:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293761664 00000100:00100000:0.0:1782487582.383771:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209798497071 time 7209802896902 state 0x0 ref 1 00000100:00100000:0.0:1782487582.383781:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209802996902 time 7209802896902 state 0x1 ref 1 00000100:00100000:0.0:1782487582.383803:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209802996902 time 7209805193185 state 0x0 ref 1 00000100:00100000:0.0:1782487582.383815:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1246:293316:x1869066293761664:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.383845:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.383864:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b851179 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747cf expref: 1246 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.383892:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b850fea lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474774 expref: 1245 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.383903:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5b:0x0].0x0 (ffff9cb4c4bb4600) 00010000:00010000:0.0:1782487582.383914:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.383992:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851458 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.384002:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851458 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.384008:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851458 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385772:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.385782:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85146d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385805:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.385813:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85146d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385831:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85146d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385845:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5b:0x0].0x0 (ffff9cb45539cc00) 00010000:00010000:0.0:1782487582.385852:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.385857:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85146d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385870:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85146d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.385893:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.385898:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.385904:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.388741:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.388746:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.388749:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.390771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.392356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.394142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.394182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.394220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.394279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.394310:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293762944 00000100:00100000:0.0:1782487582.394315:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293762944 00000100:00100000:0.0:1782487582.394351:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293762688 00000100:00100000:0.0:1782487582.394355:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293762688 00000100:00100000:0.0:1782487582.394389:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15261 00000100:00100000:0.0:1782487582.394402:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2362:x1869066293762944:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.394417:0:213223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.394434:0:213223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474918 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.394467:0:213223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17e6:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.394488:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.394500:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.394513:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 153 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.394540:0:213223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 153 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.394567:0:213223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343a00, rc 0) 00000100:00100000:0.0:1782487582.394645:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2362:x1869066293762944:12345-192.168.202.21@tcp:101:rm.500 Request processed in 245us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.394663:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15261 00000100:00100000:0.0:1782487582.396169:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293763072 00000100:00100000:0.0:1782487582.396173:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293763072 00000100:00100000:0.0:1782487582.396206:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15264 00000100:00100000:0.0:1782487582.396214:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+163:2362:x1869066293763072:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.396223:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.396249:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47491f expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.396270:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17c1:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.396283:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.396287:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.396295:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 164 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.396311:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 164 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.396324:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456342c00, rc 0) 00000100:00100000:0.0:1782487582.396355:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+164:2362:x1869066293763072:12345-192.168.202.21@tcp:101:rm.500 Request processed in 143us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.396361:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15264 00010000:00010000:0.0:1782487582.397144:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.397154:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851531 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.397174:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.397179:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851531 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.397195:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851531 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.397216:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5d:0x0].0x0 (ffff9cb558d81400) 00010000:00010000:0.0:1782487582.397221:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.397226:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851531 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.397245:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851531 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.397272:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.397277:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.397282:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.399920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.402768:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.402777:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85154d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.402795:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.402803:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85154d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.402817:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85154d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.402848:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5c:0x0].0x0 (ffff9cb4c4bb4700) 00010000:00010000:0.0:1782487582.402854:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.402860:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85154d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.402879:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85154d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.402905:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.402909:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.402913:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.404447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.404480:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293763840 00000100:00100000:0.0:1782487582.404486:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293763840 00000100:00100000:0.0:1782487582.404515:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209817420165 time 7209823148365 state 0x0 ref 1 00000100:00100000:0.0:1782487582.404526:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209823248365 time 7209823148365 state 0x1 ref 1 00000100:00100000:0.0:1782487582.404553:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209823248365 time 7209825943355 state 0x0 ref 1 00000100:00100000:0.0:1782487582.404567:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1245:293330:x1869066293763840:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.404626:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.404648:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b85137f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47488c expref: 1245 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404681:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b8511e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47482a expref: 1244 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404696:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb454b2a700) 00010000:00010000:0.0:1782487582.404707:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.404724:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404736:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404746:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404762:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85155b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404770:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85155b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404779:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85155b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404897:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404919:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.404937:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.405479:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2404, 64 off162048 00010000:00010000:0.0:1782487582.405561:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405571:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405581:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405590:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405597:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405604:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405670:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.405686:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405693:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405700:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405706:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456342a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.405710:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405717:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405728:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.405731:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.405734:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405741:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851562 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405757:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405763:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405774:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405779:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.405783:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405790:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405800:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.405803:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.405806:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405813:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851554 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.405824:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d25f882 reply state 00000000b7e417b6 transno 8589955626 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85155b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.405832:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.405897:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1244:293330:x1869066293763840:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1332us (1453us total) trans 8589955626 rc 0/0 00000100:00100000:0.0:1782487582.405906:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25366 00000100:00100000:0.0:1782487582.405912:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209823248365 time 7209825943355 state 0x2 ref 0 00010000:00010000:0.0:1782487582.405943:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.405948:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405959:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.405963:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405970:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405980:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa5f:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.405983:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.405986:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.405992:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b851569 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.406007:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.406010:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.406014:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.412957:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.412964:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b8515bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa62:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.412978:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d87200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.412983:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b8515bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa62:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.412993:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b8515bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa62:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.413012:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa62:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:0.0:1782487582.413019:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.413024:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b8515bd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.413029:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b8515bd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.413043:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.413046:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.413050:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.418937:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.418951:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.418958:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.418965:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.418970:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.418978:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.418992:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb549170d00) 00010000:00010000:0.0:1782487582.418995:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.418999:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.419006:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca200/0x66475b4e8b8515cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.452101:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293765504 00000100:00100000:0.0:1782487582.452108:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293765504 00000100:00100000:0.0:1782487582.452140:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209873613578 time 7209873513578 state 0x1 ref 2 00000100:00100000:0.0:1782487582.452168:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209873613578 time 7209873558487 state 0x0 ref 2 00000100:00100000:0.0:1782487582.452184:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+864:293345:x1869066293765504:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.452196:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.452209:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851603 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47492d expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452316:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452339:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452349:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452367:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851618 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452375:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851618 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.452382:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851618 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.452839:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17c2:0x0], index 1: 0 00010000:00010000:0.0:1782487582.452991:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85161f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453002:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85161f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453017:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85161f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453041:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453048:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453055:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453061:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.453066:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453072:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453083:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.453086:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.453089:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453096:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b851611 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.453111:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074e44d78 reply state 00000000544e3d1a transno 8589955633 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851618 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.453118:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.453141:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851603 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47492d expref: 867 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453156:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85161f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47492d expref: 866 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.453163:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9b:0x0].0x0 (ffff9cb4c9e2f500) 00010000:00010000:0.0:1782487582.453166:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.453170:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70800, rc 0) 00000100:00100000:0.0:1782487582.453213:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+867:293345:x1869066293765504:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1034us (1156us total) trans 8589955633 rc 0/0 00000100:00100000:0.0:1782487582.453222:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25373 00000100:00100000:0.0:1782487582.453227:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209873613578 time 7209873558487 state 0x2 ref 0 00010000:00010000:0.0:1782487582.457748:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457758:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457764:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457770:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.457775:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457781:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457800:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9a:0x0].0x0 (ffff9cb549170d00) 00010000:00010000:0.0:1782487582.457804:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.457807:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.457814:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b85160a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.458633:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293766016 00000100:00100000:0.0:1782487582.458639:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293766016 00000100:00100000:0.0:1782487582.458662:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209873658487 time 7209878481531 state 0x0 ref 1 00000100:00100000:0.0:1782487582.458672:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209878581531 time 7209878481531 state 0x1 ref 1 00000100:00100000:0.0:1782487582.458695:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209878581531 time 7209880086074 state 0x0 ref 1 00000100:00100000:0.0:1782487582.458707:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+866:293345:x1869066293766016:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.458749:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.458766:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85161f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47492d expref: 866 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.458779:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9b:0x0].0x0 (ffff9cb4c9e2f500) 00010000:00010000:0.0:1782487582.458799:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.458852:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.458868:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.458879:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.459025:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003afc3862 reply state 00000000b2b3b0ed transno 8589955634 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.459035:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.459117:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+869:293345:x1869066293766016:12345-192.168.202.21@tcp:36:touch.500 Request processed in 410us (557us total) trans 8589955634 rc 0/0 00000100:00100000:0.0:1782487582.459130:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25375 00000100:00100000:0.0:1782487582.460551:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293766400 00000100:00100000:0.0:1782487582.460557:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293766400 00000100:00100000:0.0:1782487582.460619:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15265 00000100:00100000:0.0:1782487582.460629:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:2361:x1869066293766400:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.460841:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+180:2361:x1869066293766400:12345-192.168.202.21@tcp:2:touch.500 Request processed in 213us (347us total) trans 8589940367 rc 0/0 00000100:00100000:0.0:1782487582.460850:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15265 00010000:00010000:0.0:1782487582.461026:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461035:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461041:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461052:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.461142:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461150:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461162:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9b:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:0.0:1782487582.461165:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.461169:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461176:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851634 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461398:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461407:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461414:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461419:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.461424:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461430:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461444:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb45539cf00) 00010000:00010000:0.0:1782487582.461448:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.461451:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.461457:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b851649 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.463257:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293767040 00000100:00100000:0.0:1782487582.463264:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293767040 00000100:00100000:0.0:1782487582.463288:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209883294654 time 7209883194654 state 0x1 ref 2 00000100:00100000:0.0:1782487582.463315:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209884788632 time 7209884704596 state 0x0 ref 2 00000100:00100000:0.0:1782487582.463339:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+870:293346:x1869066293767040:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.463378:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.463407:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b851650 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47493b expref: 871 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.463423:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9c:0x0].0x0 (ffff9cb45539cb00) 00010000:00010000:0.0:1782487582.463434:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.463481:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.463491:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.463502:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.463658:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008208d7d9 reply state 0000000017aac899 transno 8589955636 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.463667:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.463724:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+872:293346:x1869066293767040:12345-192.168.202.21@tcp:36:touch.500 Request processed in 388us (523us total) trans 8589955636 rc 0/0 00000100:00100000:0.0:1782487582.463738:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25379 00010000:00010000:0.0:1782487582.464396:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464409:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464425:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464437:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.464443:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464452:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464467:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9c:0x0].0x0 (ffff9cb4c9e2f000) 00010000:00010000:0.0:1782487582.464472:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.464477:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.464491:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851673 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.465559:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293767808 00000100:00100000:0.0:1782487582.465566:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293767808 00000100:00100000:0.0:1782487582.465643:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5446 00000100:00100000:0.0:1782487582.465656:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+875:293345:x1869066293767808:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.465856:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+875:293345:x1869066293767808:12345-192.168.202.21@tcp:35:touch.500 Request processed in 204us (354us total) trans 8589955639 rc 0/0 00000100:00100000:0.0:1782487582.465864:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5446 00000100:00100000:0.0:1782487582.466463:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293768064 00000100:00100000:0.0:1782487582.466469:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293768064 00000100:00100000:0.0:1782487582.466486:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209884804596 time 7209886936670 state 0x0 ref 1 00000100:00100000:0.0:1782487582.466496:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209887036670 time 7209886936670 state 0x1 ref 1 00000100:00100000:0.0:1782487582.466519:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209887036670 time 7209887909776 state 0x0 ref 1 00000100:00100000:0.0:1782487582.466532:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+874:293349:x1869066293768064:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.466559:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.466574:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d87200/0x66475b4e8b851681 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474949 expref: 874 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.466588:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9d:0x0].0x0 (ffff9cb549170000) 00010000:00010000:0.0:1782487582.466597:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.466686:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.466696:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.466704:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.466773:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000904d19fa reply state 000000002940859b transno 8589955640 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.466780:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.466855:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+875:293349:x1869066293768064:12345-192.168.202.21@tcp:36:touch.500 Request processed in 325us (435us total) trans 8589955640 rc 0/0 00000100:00100000:0.0:1782487582.466864:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25381 00000100:00100000:0.0:1782487582.466869:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209887036670 time 7209887909776 state 0x2 ref 0 00000100:00100000:0.0:1782487582.466888:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293768448 00000100:00100000:0.0:1782487582.466891:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293768448 00000100:00100000:0.0:1782487582.466904:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209887036670 time 7209887909776 state 0x0 ref 1 00000100:00100000:0.0:1782487582.466911:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209888009776 time 7209887909776 state 0x1 ref 1 00000100:00100000:0.0:1782487582.466927:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209888009776 time 7209888318449 state 0x0 ref 1 00000100:00100000:0.0:1782487582.466945:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+875:293351:x1869066293768448:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.466954:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.466965:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85169d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474957 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467080:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467090:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467098:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467113:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467121:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467128:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.467530:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17ea:0x0], index 0: 0 00010000:00010000:0.0:1782487582.467691:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8516b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467701:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8516b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467710:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8516b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467733:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467738:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467743:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467749:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.467752:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467757:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467766:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.467769:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.467773:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467778:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b8516a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.467790:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015a4a1a5 reply state 000000005dcc3dad transno 8589955641 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.467797:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.467818:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85169d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474957 expref: 878 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467834:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8516b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474957 expref: 877 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467841:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.467844:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.467847:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196c800, rc 0) 00000100:00100000:0.0:1782487582.467884:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+878:293351:x1869066293768448:12345-192.168.202.21@tcp:101:touch.500 Request processed in 941us (1035us total) trans 8589955641 rc 0/0 00000100:00100000:0.0:1782487582.467894:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25382 00000100:00100000:0.0:1782487582.467899:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209888009776 time 7209888318449 state 0x2 ref 0 00010000:00010000:0.0:1782487582.467927:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467935:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467942:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467949:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.467952:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467959:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467969:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9d:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:0.0:1782487582.467973:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.467977:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.467983:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851696 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.469308:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209890664839 time 7209890696092 state 0x0 ref 2 00000100:00100000:0.0:1782487582.469324:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+879:293351:x1869066293769088:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.469363:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.469381:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8516b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474957 expref: 879 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.469395:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.469404:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.469443:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.469453:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.469461:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.469553:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2c1845d reply state 00000000d8dd4dde transno 8589955642 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.469565:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.469628:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+881:293351:x1869066293769088:12345-192.168.202.21@tcp:36:touch.500 Request processed in 308us (626us total) trans 8589955642 rc 0/0 00000100:00100000:0.0:1782487582.469655:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25384 00000100:00100000:0.0:1782487582.470961:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293769472 00000100:00100000:0.0:1782487582.470966:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293769472 00000100:00100000:0.0:1782487582.470997:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15268 00000100:00100000:0.0:1782487582.471005:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+161:2362:x1869066293769472:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.471208:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+162:2362:x1869066293769472:12345-192.168.202.21@tcp:2:touch.500 Request processed in 204us (281us total) trans 8589939671 rc 0/0 00000100:00100000:0.0:1782487582.471216:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15268 00010000:00010000:0.0:1782487582.473676:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473690:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473699:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473714:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.473720:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473728:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473743:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:0.0:1782487582.473746:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.473751:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.473758:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b8516c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.474289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.474728:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293770368 00000100:00100000:0.0:1782487582.474734:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293770368 00000100:00100000:0.0:1782487582.474753:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209891162493 time 7209895511362 state 0x0 ref 1 00000100:00100000:0.0:1782487582.474764:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209895611362 time 7209895511362 state 0x1 ref 1 00000100:00100000:0.0:1782487582.474790:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209895611362 time 7209896179781 state 0x0 ref 1 00000100:00100000:0.0:1782487582.474803:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+882:293358:x1869066293770368:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.474829:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.474853:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b8516e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474965 expref: 882 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.474869:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9f:0x0].0x0 (ffff9cb45539c800) 00010000:00010000:0.0:1782487582.474880:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.474935:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.474946:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.474957:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.475058:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000355d48bc reply state 000000001cf143c6 transno 8589955646 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.475067:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.475132:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+883:293358:x1869066293770368:12345-192.168.202.21@tcp:36:touch.500 Request processed in 331us (443us total) trans 8589955646 rc 0/0 00000100:00100000:0.0:1782487582.475143:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25387 00000100:00100000:0.0:1782487582.475150:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209895611362 time 7209896179781 state 0x2 ref 0 00010000:00010000:0.0:1782487582.475775:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475789:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475796:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475802:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.475806:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475813:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475825:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9f:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.475828:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.475832:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.475839:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b8516f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.476224:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293770624 00000100:00100000:0.0:1782487582.476229:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293770624 00000100:00100000:0.0:1782487582.476258:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209896702377 time 7209896602377 state 0x1 ref 2 00000100:00100000:0.0:1782487582.476285:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209896702377 time 7209897674998 state 0x0 ref 2 00000100:00100000:0.0:1782487582.476297:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+884:293358:x1869066293770624:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.476307:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.476329:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851714 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47497a expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.476361:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851714 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47497a expref: 885 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.476373:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b851714 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47497a expref: 885 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.476389:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9f:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:0.0:1782487582.476393:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.476396:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71400, rc 0) 00000100:00100000:0.0:1782487582.476437:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+886:293358:x1869066293770624:12345-192.168.202.21@tcp:101:touch.500 Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.476446:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25389 00010000:00010000:0.0:1782487582.480858:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480872:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480880:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480887:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025a800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.480892:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480900:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480920:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb45539cd00) 00010000:00010000:0.0:1782487582.480924:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.480929:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.480935:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025a800/0x66475b4e8b85170d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.481805:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209903294403 time 7209903194403 state 0x1 ref 2 00000100:00100000:0.0:1782487582.481818:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+887:293355:x1869066293771264:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.481844:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.481860:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b85171b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474973 expref: 888 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.481873:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb45539c600) 00010000:00010000:0.0:1782487582.481882:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.481923:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.481936:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.481946:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.482015:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000048c8318 reply state 00000000ed17305e transno 8589955649 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.482027:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.482071:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+889:293355:x1869066293771264:12345-192.168.202.21@tcp:36:touch.500 Request processed in 256us (1170us total) trans 8589955649 rc 0/0 00000100:00100000:0.0:1782487582.482079:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25390 00010000:00010000:0.0:1782487582.486200:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486229:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486249:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486257:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.486262:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486271:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486289:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:0.0:1782487582.486292:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.486297:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486304:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b851730 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486341:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486352:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486358:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486365:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.486369:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486376:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486387:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb549170500) 00010000:00010000:0.0:1782487582.486391:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.486395:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.486401:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71600/0x66475b4e8b85173e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.486655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.489649:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293771776 00000100:00100000:0.0:1782487582.489657:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293771776 00000100:00100000:0.0:1782487582.489686:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209903294403 time 7209903206212 state 0x0 ref 1 00000100:00100000:0.0:1782487582.489700:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209903306212 time 7209903206212 state 0x1 ref 1 00000100:00100000:0.0:1782487582.489732:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293772160 00000100:00100000:0.0:1782487582.489735:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293772160 00000100:00100000:0.0:1782487582.489751:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7209903306212 time 7209903206212 state 0x1 ref 2 00000100:00100000:0.0:1782487582.489772:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209911262419 time 7209911162419 state 0x1 ref 2 00000100:00100000:0.0:1782487582.489785:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+890:293355:x1869066293771776:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.489804:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.489826:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851753 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474988 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.489883:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474988 expref: 891 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.489906:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b851753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474988 expref: 890 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.489926:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.489931:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.489934:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71200, rc 0) 00000100:00100000:0.0:1782487582.489978:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+890:293355:x1869066293771776:12345-192.168.202.21@tcp:101:touch.500 Request processed in 197us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.489988:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25392 00000100:00100000:0.0:1782487582.491205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.491589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.491808:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15271 00000100:00100000:0.0:1782487582.491821:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+182:2361:x1869066293772416:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.492068:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+183:2361:x1869066293772416:12345-192.168.202.21@tcp:2:touch.500 Request processed in 250us (480us total) trans 8589940370 rc 0/0 00000100:00100000:0.0:1782487582.492080:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15271 00000100:00100000:0.0:1782487582.492672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.493189:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293772800 00000100:00100000:0.0:1782487582.493195:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293772800 00000100:00100000:0.0:1782487582.493258:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5451 00000100:00100000:0.0:1782487582.493269:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+891:293355:x1869066293772800:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.493486:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+892:293355:x1869066293772800:12345-192.168.202.21@tcp:35:touch.500 Request processed in 220us (342us total) trans 8589955653 rc 0/0 00000100:00100000:0.0:1782487582.493495:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5451 00000100:00100000:0.0:1782487582.493730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.493889:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.496694:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.496732:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.496772:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293773312 00000100:00100000:0.0:1782487582.496777:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293773312 00000100:00100000:0.0:1782487582.496818:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1000 00000100:00100000:0.0:1782487582.496829:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+894:2360:x1869066293773312:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.496864:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.496879:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851784 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47499d expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.496911:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.496922:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.496948:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.496964:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497134:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497144:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497247:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497257:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497266:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.497283:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9a:0x0]: returning size 0 00000004:00200000:0.0:1782487582.497287:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.497301:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497311:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497320:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497331:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497339:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497345:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7fe600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.497350:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497357:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497368:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.497371:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.497375:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497382:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7fe600/0x66475b4e8b85178b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497394:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497401:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497408:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497414:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7ff200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.497419:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497426:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497437:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4c9e2fe00) 00010000:00010000:0.0:1782487582.497440:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.497443:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497449:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851792 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497480:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851784 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47499d expref: 896 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497494:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51400/0x66475b4e8b851799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47499d expref: 895 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497502:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9a:0x0].0x0 (ffff9cb549170d00) 00010000:00010000:0.0:1782487582.497505:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.497508:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454f51400, rc 0) 00010000:00010000:0.0:1782487582.497512:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.497522:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8517a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749a4 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497546:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497555:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497574:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497715:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497725:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497734:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.497929:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498024:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498034:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.498052:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9c:0x0]: returning size 0 00000004:00200000:0.0:1782487582.498055:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.498065:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498076:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498086:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498098:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498105:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498111:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.498115:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498122:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498132:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.498135:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.498139:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498146:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8517a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498158:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498165:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498172:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498179:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456342e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.498184:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498191:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498201:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4c9e2f000) 00010000:00010000:0.0:1782487582.498206:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.498211:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498218:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b8517ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498328:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c800/0x66475b4e8b8517a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749a4 expref: 897 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498359:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b8517b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749a4 expref: 896 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498375:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9c:0x0].0x0 (ffff9cb549170400) 00010000:00010000:0.0:1782487582.498378:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.498381:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456342a00, rc 0) 00010000:00010000:0.0:1782487582.498386:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.498395:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b8517bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749ab expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498420:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498429:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498438:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498455:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498463:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498472:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498535:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498544:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.498552:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.498581:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9b:0x0]: returning size 0 00000004:00200000:0.0:1782487582.498584:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.499014:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499026:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499059:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499083:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499091:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499106:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.499111:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499129:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499154:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.499158:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.499161:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499168:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8517c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499181:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499188:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499195:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499203:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.499208:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499214:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499222:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c9e2fc00) 00010000:00010000:0.0:1782487582.499225:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.499228:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499248:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b8517ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499280:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b8517bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749ab expref: 902 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499297:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571e00/0x66475b4e8b8517d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749ab expref: 901 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499305:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9b:0x0].0x0 (ffff9cb45539c500) 00010000:00010000:0.0:1782487582.499308:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.499312:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467571e00, rc 0) 00010000:00010000:0.0:1782487582.499319:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.499331:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1600/0x66475b4e8b8517fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749b2 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499360:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499374:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499384:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499396:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499404:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499411:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499475:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499486:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499507:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.499532:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9e:0x0]: returning size 0 00000004:00200000:0.0:1782487582.499537:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.499549:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499574:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499600:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499630:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499641:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499656:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558610600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.499663:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499671:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499681:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.499684:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.499688:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499697:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851802 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499727:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499741:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499753:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499763:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.499768:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499776:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499784:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c9e2f100) 00010000:00010000:0.0:1782487582.499787:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.499790:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499800:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851809 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499841:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1600/0x66475b4e8b8517fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749b2 expref: 902 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499868:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b851810 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749b2 expref: 901 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499877:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb45539c100) 00010000:00010000:0.0:1782487582.499881:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.499885:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611000, rc 0) 00010000:00010000:0.0:1782487582.499890:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.499899:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610800/0x66475b4e8b85181e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749b9 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499931:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499967:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.499983:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500001:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500021:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500031:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500110:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500119:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500127:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.500143:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa0:0x0]: returning size 0 00000004:00200000:0.0:1782487582.500148:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.500161:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500182:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500190:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500207:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500215:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500227:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558610a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.500242:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500250:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500283:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.500289:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.500294:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500305:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b85182c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500327:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500336:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500347:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500364:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558610c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.500371:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500381:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500390:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c9e2fb00) 00010000:00010000:0.0:1782487582.500393:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.500397:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500403:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b85183a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500428:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610800/0x66475b4e8b85181e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749b9 expref: 904 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500441:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611c00/0x66475b4e8b851841 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749b9 expref: 903 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500449:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.500452:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.500457:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611c00, rc 0) 00010000:00010000:0.0:1782487582.500463:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.500474:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610000/0x66475b4e8b85184f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749c0 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500506:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500526:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500536:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500553:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500572:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500581:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.500640:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293773952 00000100:00100000:0.0:1782487582.500645:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293773952 00000100:00100000:0.0:1782487582.500681:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1001 00000100:00100000:0.0:1782487582.500691:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+905:2361:x1869066293773952:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.500718:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.500729:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b851864 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749e3 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500752:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500763:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500772:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500792:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500804:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500816:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500882:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500891:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500910:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.500930:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9e:0x0]: returning size 0 00000004:00200000:0.0:1782487582.500935:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.500948:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500961:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500978:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500988:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.500996:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501007:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.501011:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501018:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501029:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.501032:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.501035:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501042:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85186b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501055:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501060:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501067:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501084:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.501089:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501108:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501135:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c9e2f500) 00010000:00010000:0.0:1782487582.501138:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.501142:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501153:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49cc00/0x66475b4e8b851872 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501181:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b851864 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749e3 expref: 907 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501208:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c200/0x66475b4e8b851880 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749e3 expref: 906 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501225:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb45539c100) 00010000:00010000:0.0:1782487582.501230:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.501370:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c200, rc 0) 00010000:00010000:0.0:1782487582.501377:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.501387:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b85189c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749f1 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501410:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501419:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501428:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501447:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501455:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501463:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501529:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501538:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501545:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.501558:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa0:0x0]: returning size 0 00000004:00200000:0.0:1782487582.501561:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.501570:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501579:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501661:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501671:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501696:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501706:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.501710:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501717:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501727:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.501731:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.501737:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501795:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b8518a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501811:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501818:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501825:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501831:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb55919c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.501835:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501846:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501858:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4bb4000) 00010000:00010000:0.0:1782487582.501861:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.501865:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501871:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b8518aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501901:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b85189c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749f1 expref: 907 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501916:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180400/0x66475b4e8b8518b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749f1 expref: 906 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501923:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.501926:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.501929:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547180400, rc 0) 00010000:00010000:0.0:1782487582.501933:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.501941:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b8518b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4749f8 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501963:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501973:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501983:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.501994:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502005:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502015:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502053:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502061:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502071:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502079:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547181c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.502084:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502098:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502108:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.502111:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.502115:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502125:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b8518bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502139:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502147:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502155:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502171:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.502177:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502187:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502198:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.502202:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.502206:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502212:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b8518c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502231:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b8518b8 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749f8 expref: 909 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502258:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.502263:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.502269:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b8518b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749f8 expref: 909 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502284:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547180c00, rc -2) 00000100:00100000:0.0:1782487582.502323:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+908:2361:x1869066293773952:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1632us (4121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.502332:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1001 00000100:00100000:0.0:1782487582.502352:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293774208 00000100:00100000:0.0:1782487582.502357:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293774208 00000100:00100000:0.0:1782487582.502380:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1003 00000100:00100000:0.0:1782487582.502391:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+908:2361:x1869066293774208:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.502418:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.502430:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b8518e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a45 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502464:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502496:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502507:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502531:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502547:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502567:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502717:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502729:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502738:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.502817:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9b:0x0]: returning size 0 00000004:00200000:0.0:1782487582.502822:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.502835:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502850:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502868:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502881:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502890:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502899:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547181200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.502904:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502911:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502923:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.502926:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.502929:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502936:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b8518f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502954:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502968:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502977:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.502988:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.502992:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503007:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503036:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c4bb4800) 00010000:00010000:0.0:1782487582.503042:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.503047:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503063:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b8518f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503098:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b8518e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a45 expref: 911 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503118:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0c00/0x66475b4e8b8518fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a45 expref: 910 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503138:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9b:0x0].0x0 (ffff9cb45539c500) 00010000:00010000:0.0:1782487582.503145:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.503149:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5821f0c00, rc 0) 00010000:00010000:0.0:1782487582.503155:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.503167:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851921 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a53 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503196:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503208:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503226:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503265:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503280:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503292:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503372:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503392:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503410:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.503427:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9e:0x0]: returning size 0 00000004:00200000:0.0:1782487582.503430:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.503442:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503451:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503460:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503470:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503493:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503501:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.503506:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503516:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503538:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.503542:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.503546:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503566:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851928 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503672:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503682:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503690:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503704:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.503710:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503750:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503775:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c4bb4700) 00010000:00010000:0.0:1782487582.503777:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.503781:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503791:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b85192f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503834:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851921 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a53 expref: 913 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503857:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499400/0x66475b4e8b85194b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a53 expref: 912 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503876:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb45539c100) 00010000:00010000:0.0:1782487582.503880:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.503883:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558499400, rc 0) 00010000:00010000:0.0:1782487582.503888:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.503972:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85196e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a61 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.503999:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504019:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504035:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504049:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504058:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504073:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504140:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504151:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504171:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.504188:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa0:0x0]: returning size 0 00000004:00200000:0.0:1782487582.504192:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.504203:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504219:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504229:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504252:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504260:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504268:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558499800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.504275:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504284:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504305:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.504311:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.504316:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504325:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b85197c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504338:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504348:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504355:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504363:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.504369:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504384:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504395:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb45539c600) 00010000:00010000:0.0:1782487582.504398:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.504402:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504408:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851983 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504432:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85196e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a61 expref: 916 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504445:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b85198a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a61 expref: 915 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504452:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.504458:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.504464:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb450138200, rc 0) 00010000:00010000:0.0:1782487582.504468:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.504480:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b8519a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a6f expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504509:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504521:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504532:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.504561:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293774464 00000100:00100000:0.0:1782487582.504567:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293774464 00000100:00100000:0.0:1782487582.504642:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293774336 00000100:00100000:0.0:1782487582.504647:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293774336 00000100:00100000:0.0:1782487582.504682:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15274 00000100:00100000:0.0:1782487582.504697:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+165:2363:x1869066293774464:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.504710:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.504727:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a99 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.504756:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17c2:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.504772:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.504778:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.504787:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 166 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504802:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 166 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.504814:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d9400, rc 0) 00000100:00100000:0.0:1782487582.504853:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2363:x1869066293774464:12345-192.168.202.21@tcp:101:rm.500 Request processed in 161us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.504863:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15274 00000100:00100000:0.0:1782487582.504882:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293774848 00000100:00100000:0.0:1782487582.504885:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293774848 00000100:00100000:0.0:1782487582.504917:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15275 00000100:00100000:0.0:1782487582.504932:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+184:2361:x1869066293774336:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.504946:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.504963:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474aa0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.504991:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17e9:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.505005:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.505011:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.505019:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 185 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505045:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 185 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505056:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d34800, rc 0) 00000100:00100000:0.0:1782487582.505079:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+185:2361:x1869066293774336:12345-192.168.202.21@tcp:101:rm.500 Request processed in 151us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.505086:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15275 00000100:00100000:0.0:1782487582.505105:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15276 00000100:00100000:0.0:1782487582.505116:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+184:2362:x1869066293774848:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.505128:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.505152:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474aae expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.505183:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17e8:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.505194:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.505202:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.505214:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 185 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505230:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 185 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505253:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d34000, rc 0) 00000100:00100000:0.0:1782487582.505276:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+185:2362:x1869066293774848:12345-192.168.202.21@tcp:101:rm.500 Request processed in 164us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.505284:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15276 00010000:00010000:0.0:1782487582.505450:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505459:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505467:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505473:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.505477:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505484:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505496:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.505499:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.505503:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505510:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851856 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505528:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505534:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505541:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505547:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.505551:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505558:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505568:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.505570:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.505574:0:213491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505582:0:213491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505589:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505626:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505633:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611a00/0x66475b4e8b85185d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505657:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610000/0x66475b4e8b85184f lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749c0 expref: 916 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505668:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.505671:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.505676:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610000/0x66475b4e8b85184f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749c0 expref: 916 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505691:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558610000, rc -2) 00000100:00100000:0.0:1782487582.505731:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+915:2360:x1869066293773312:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 8905us (9039us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.505740:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1000 00010000:00010000:0.0:1782487582.505768:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505777:0:213217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505785:0:213217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505797:0:213217:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.505807:0:213217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.508530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.508592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.509172:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15278 00000100:00100000:0.0:1782487582.509186:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+186:2360:x1869066293774976:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:0.0:1782487582.509194:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.509216:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474ab5 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.509260:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17ea:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.509279:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.509288:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.509300:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 188 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509330:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 188 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509342:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb455051400, rc 0) 00000100:00100000:0.0:1782487582.509374:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+188:2360:x1869066293774976:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 190us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.509384:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15278 00010000:00010000:0.0:1782487582.509476:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509483:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509488:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509493:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.509497:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509501:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509510:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.509513:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.509516:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509522:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509526:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509544:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509559:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b8519d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509587:0:213217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509600:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509731:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509740:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509746:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.509768:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.509781:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509789:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509798:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509804:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509811:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509818:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.509821:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509828:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509845:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.509847:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.509849:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509854:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9a00/0x66475b4e8b8519ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509861:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509867:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509874:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509880:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.509884:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509890:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509903:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f300) 00010000:00010000:0.0:1782487582.509906:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.509910:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509915:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050400/0x66475b4e8b8519de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509960:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9600/0x66475b4e8b8519a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 915 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509974:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 914 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.509982:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb45539cd00) 00010000:00010000:0.0:1782487582.509985:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.509988:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb455050200, rc 0) 00010000:00010000:0.0:1782487582.509995:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.510005:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050a00/0x66475b4e8b851a08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a7d expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510047:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510056:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510064:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510081:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510089:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510107:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510170:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510179:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510187:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.510200:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9f:0x0]: returning size 0 00000004:00200000:0.0:1782487582.510203:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.510213:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510221:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510229:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510244:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510255:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510261:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5821f0600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.510264:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510275:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510285:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.510288:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.510292:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510298:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5821f0600/0x66475b4e8b851a0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510311:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510318:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510324:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510330:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.510334:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510345:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510354:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb46f434000) 00010000:00010000:0.0:1782487582.510357:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.510360:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510367:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b851a16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510391:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050a00/0x66475b4e8b851a08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a7d expref: 916 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510403:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498a00/0x66475b4e8b851a1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a7d expref: 915 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510410:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9f:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:0.0:1782487582.510413:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.510415:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498a00, rc 0) 00010000:00010000:0.0:1782487582.510421:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.510429:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851a24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a84 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510450:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510459:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510472:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510485:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510492:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510499:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510561:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510570:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510579:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.510594:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa1:0x0]: returning size 0 00000004:00200000:0.0:1782487582.510597:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.510628:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510638:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510646:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510656:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510662:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510668:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.510672:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510678:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510687:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.510690:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.510693:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510700:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498200/0x66475b4e8b851a2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510711:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510717:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510723:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510729:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.510733:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510740:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510750:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb46f434300) 00010000:00010000:0.0:1782487582.510753:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.510756:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510761:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851a32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510787:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558499800/0x66475b4e8b851a24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a84 expref: 917 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510801:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181400/0x66475b4e8b851a39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a84 expref: 916 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510809:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa1:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:0.0:1782487582.510811:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.510814:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547181400, rc 0) 00010000:00010000:0.0:1782487582.510819:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.510827:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851a40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474a8b expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510853:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510862:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510871:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510888:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510898:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.510907:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.510963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.510998:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293775360 00000100:00100000:0.0:1782487582.511003:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293775360 00000100:00100000:0.0:1782487582.511026:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209922262696 time 7209926354227 state 0x0 ref 1 00000100:00100000:0.0:1782487582.511038:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209926454227 time 7209926354227 state 0x1 ref 1 00000100:00100000:0.0:1782487582.511061:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209926454227 time 7209932451411 state 0x0 ref 1 00000100:00100000:0.0:1782487582.511072:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+918:293356:x1869066293775360:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.511105:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.511120:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b8519e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa7 expref: 918 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511133:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb45539cd00) 00010000:00010000:0.0:1782487582.511137:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.511181:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511193:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 917 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511201:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511258:0:213935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 917 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511274:0:213935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 917 pid: 213217 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.511291:0:213935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299123584:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.511366:0:213935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb547721480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.511389:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293775616 00000100:00100000:0.0:1782487582.511394:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293775616 00000100:00100000:0.0:1782487582.511414:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209932551411 time 7209932451411 state 0x1 ref 2 00000100:00100000:0.0:1782487582.511438:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209932551411 time 7209932828649 state 0x0 ref 2 00000100:00100000:0.0:1782487582.511450:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+918:293367:x1869066293775616:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.511460:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.511470:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851a5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474ac3 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511548:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511558:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511567:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511580:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511587:0:190296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511593:0:190296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511603:0:190296:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511638:0:190296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511709:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511717:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511723:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511729:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547181200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.511734:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511741:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511752:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.511755:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.511759:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511766:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851a47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511779:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511786:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511793:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511799:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.511803:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511810:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511820:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb46f434b00) 00010000:00010000:0.0:1782487582.511823:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.511826:0:213217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511851:0:213217:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511857:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511949:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511957:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851a4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511981:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851a40 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a8b expref: 919 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.511990:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.511993:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.511998:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851a40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a8b expref: 919 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.512008:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547180a00, rc -2) 00010000:00010000:0.0:1782487582.512031:0:190296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.512038:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.512752:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17c6:0x0], index 1: 0 00010000:00010000:0.0:1782487582.513066:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b851a71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513074:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b851a71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513080:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b851a71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513106:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513111:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513115:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513119:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb55919c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.513122:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513126:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513133:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.513135:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.513137:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513141:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851a63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.513151:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058c4628e reply state 00000000d7c7df4d transno 8589955656 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.513157:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.513176:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851a5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ac3 expref: 920 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513186:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49d000/0x66475b4e8b851a71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ac3 expref: 919 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.513191:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434100) 00010000:00010000:0.0:1782487582.513193:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.513195:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49d000, rc 0) 00000100:00100000:0.0:1782487582.513249:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+920:293367:x1869066293775616:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1801us (1910us total) trans 8589955656 rc 0/0 00000100:00100000:0.0:1782487582.513258:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25401 00000100:00100000:0.0:1782487582.513305:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+919:2361:x1869066293774208:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 10917us (11219us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.513313:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1003 00010000:00010000:0.0:1782487582.514205:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514215:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514222:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514248:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49de00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.514253:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514261:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514273:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb46f434b00) 00010000:00010000:0.0:1782487582.514276:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.514280:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.514287:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b851a6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.516391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.516453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.516480:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293776000 00000100:00100000:0.0:1782487582.516485:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293776000 00010000:00010000:0.0:1782487582.516508:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 919 pid: 213217 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.516539:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5728 00000100:00100000:0.0:1782487582.516547:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472811880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+919:2363:x1869066293776000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.516560:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.516566:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 919 pid: 213217 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516590:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 919 pid: 213217 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516632:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b851a01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a6f expref: 919 pid: 213217 timeout: 7309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516650:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb45539cd00) 00010000:00010000:0.0:1782487582.516656:0:192469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516668:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516676:0:192469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.516707:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.516745:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472811880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+917:2363:x1869066293776000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 196us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.516762:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5728 00000100:00100000:0.0:1782487582.516976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.517049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.517128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.517222:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15280 00000100:00100000:0.0:1782487582.517252:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+167:2360:x1869066293776128:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:0.0:1782487582.517264:0:190930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.517279:0:190930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474aca expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.517300:0:190930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17c4:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.517314:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=7209s v=(0 0) 00010000:00010000:0.0:1782487582.517321:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.517331:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 169 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.517355:0:190930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 169 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.517377:0:190930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558610000, rc 0) 00000100:00100000:0.0:1782487582.517411:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+169:2360:x1869066293776128:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 175us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.517424:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15280 00010000:00010000:0.0:1782487582.518106:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518114:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518119:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518122:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.518125:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518135:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518155:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb45a514b00) 00010000:00010000:0.0:1782487582.518157:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.518162:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518176:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851a7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518482:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518493:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518501:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518507:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.518511:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518520:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518531:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb45539cd00) 00010000:00010000:0.0:1782487582.518534:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.518538:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518549:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851a55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.518581:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293776640 00000100:00100000:0.0:1782487582.518585:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293776640 00000100:00100000:0.0:1782487582.518629:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209938002536 time 7209938432069 state 0x0 ref 1 00000100:00100000:0.0:1782487582.518640:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209938532069 time 7209938432069 state 0x1 ref 1 00000100:00100000:0.0:1782487582.518665:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209938532069 time 7209940055406 state 0x0 ref 1 00000100:00100000:0.0:1782487582.518677:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+920:293367:x1869066293776640:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.518686:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.518699:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851ab7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474adf expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518730:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474adf expref: 921 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518742:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611e00/0x66475b4e8b851ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474adf expref: 921 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518758:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434f00) 00010000:00010000:0.0:1782487582.518762:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.518765:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611e00, rc 0) 00000100:00100000:0.0:1782487582.518803:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+921:293367:x1869066293776640:12345-192.168.202.21@tcp:101:touch.500 Request processed in 128us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.518814:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25404 00000100:00100000:0.0:1782487582.518819:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209938532069 time 7209940055406 state 0x2 ref 0 00010000:00010000:0.0:1782487582.518933:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518941:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518948:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518954:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.518958:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518966:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518976:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb45a514300) 00010000:00010000:0.0:1782487582.518979:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.518983:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.518989:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851a9b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.520059:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293776768 00000100:00100000:0.0:1782487582.520066:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293776768 00000100:00100000:0.0:1782487582.520088:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209938532069 time 7209940055406 state 0x0 ref 1 00000100:00100000:0.0:1782487582.520102:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209940155406 time 7209940055406 state 0x1 ref 1 00000100:00100000:0.0:1782487582.520132:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293777280 00000100:00100000:0.0:1782487582.520137:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293777280 00000100:00100000:0.0:1782487582.520155:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209940155406 time 7209940055406 state 0x1 ref 2 00000100:00100000:0.0:1782487582.520187:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209941676343 time 7209941576343 state 0x1 ref 3 00000100:00100000:0.0:1782487582.520202:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+922:293356:x1869066293776768:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.520216:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.520231:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b851abe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474ae6 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.520285:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b851abe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ae6 expref: 923 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.520307:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610c00/0x66475b4e8b851abe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ae6 expref: 923 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.520327:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb46f434b00) 00010000:00010000:0.0:1782487582.520334:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.520339:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558610c00, rc 0) 00000100:00100000:0.0:1782487582.520379:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+923:293356:x1869066293776768:12345-192.168.202.21@tcp:101:touch.500 Request processed in 178us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.520392:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25405 00010000:00010000:0.0:1782487582.521077:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521091:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521098:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521105:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.521111:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521119:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521135:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa4:0x0].0x0 (ffff9cb45539cb00) 00010000:00010000:0.0:1782487582.521139:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.521143:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521149:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851acc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.521431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.521467:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293777536 00000100:00100000:0.0:1782487582.521471:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293777536 00000100:00100000:0.0:1782487582.521488:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 0 deadline 7209941767720 time 7209941667720 state 0x1 ref 2 00000100:00100000:0.0:1782487582.521514:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209941767720 time 7209942901495 state 0x0 ref 1 00000100:00100000:0.0:1782487582.521525:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+924:293365:x1869066293777536:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.521533:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.521553:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851aef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474af4 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521588:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474af4 expref: 925 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521643:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610600/0x66475b4e8b851aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaa4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474af4 expref: 925 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.521665:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa4:0x0].0x0 (ffff9cb46f434300) 00010000:00010000:0.0:1782487582.521669:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.521672:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558610600, rc 0) 00000100:00100000:0.0:1782487582.521700:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+925:293365:x1869066293777536:12345-192.168.202.21@tcp:101:touch.500 Request processed in 177us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.521707:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25408 00000100:00100000:0.0:1782487582.521711:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209941767720 time 7209942901495 state 0x2 ref 0 00000100:00100000:0.0:1782487582.521752:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293777664 00000100:00100000:0.0:1782487582.521757:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293777664 00000100:00100000:0.0:1782487582.521796:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15282 00000100:00100000:0.0:1782487582.521808:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+187:2363:x1869066293777664:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.522004:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+188:2363:x1869066293777664:12345-192.168.202.21@tcp:2:touch.500 Request processed in 199us (365us total) trans 8589940371 rc 0/0 00000100:00100000:0.0:1782487582.522025:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15282 00010000:00010000:0.0:1782487582.522154:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522161:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522166:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522171:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578dea200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.522174:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522178:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522187:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb45a514400) 00010000:00010000:0.0:1782487582.522190:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.522203:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.522210:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851ada lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.523265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.523329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.524928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.524970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.525020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.525048:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293778688 00000100:00100000:0.0:1782487582.525053:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293778688 00000100:00100000:0.0:1782487582.525079:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293778816 00000100:00100000:0.0:1782487582.525082:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293778816 00000100:00100000:0.0:1782487582.525099:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293779072 00000100:00100000:0.0:1782487582.525102:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293779072 00000100:00100000:0.0:1782487582.525125:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5453 00000100:00100000:0.0:1782487582.525136:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+930:293365:x1869066293778688:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.525369:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+932:293365:x1869066293778688:12345-192.168.202.21@tcp:35:touch.500 Request processed in 234us (441us total) trans 8589955664 rc 0/0 00000100:00100000:0.0:1782487582.525378:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5453 00000100:00100000:0.0:1782487582.525401:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5455 00000100:00100000:0.0:1782487582.525416:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+931:293356:x1869066293779072:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.525561:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+931:293356:x1869066293779072:12345-192.168.202.21@tcp:35:touch.500 Request processed in 149us (540us total) trans 8589955666 rc 0/0 00000100:00100000:0.0:1782487582.525569:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5455 00000100:00100000:0.0:1782487582.525716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.525770:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525780:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525787:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525793:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.525798:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525805:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525818:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa5:0x0].0x0 (ffff9cb45539cf00) 00010000:00010000:0.0:1782487582.525821:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.525826:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525842:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851b0b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525883:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525892:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525900:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525906:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb540031800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.525910:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525916:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525926:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb45a514f00) 00010000:00010000:0.0:1782487582.525929:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.525932:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.525939:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b851b04 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.525989:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.526026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.526059:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.526096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.526179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.526202:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293779712 00000100:00100000:0.0:1782487582.526206:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293779712 00000100:00100000:0.0:1782487582.526225:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209947360720 time 7209947260720 state 0x1 ref 2 00000100:00100000:0.0:1782487582.526254:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293779840 00000100:00100000:0.0:1782487582.526258:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293779840 00000100:00100000:0.0:1782487582.526276:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209947360720 time 7209947260720 state 0x1 ref 4 00000100:00100000:0.0:1782487582.526296:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209947786540 time 7209947686540 state 0x1 ref 4 00000100:00100000:0.0:1782487582.526312:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+934:293375:x1869066293779328:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.526325:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.526337:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851b27 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474b09 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526379:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526390:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526400:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526418:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526436:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526452:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526549:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526560:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526569:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.526590:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9e:0x0]: returning size 0 00000004:00200000:0.0:1782487582.526595:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.526633:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526644:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526656:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526664:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526675:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526682:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.526687:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526694:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526704:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.526707:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.526711:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526717:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611400/0x66475b4e8b851b35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526732:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526739:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526746:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526752:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.526756:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526763:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526773:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb46f434000) 00010000:00010000:0.0:1782487582.526779:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.526784:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526796:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b851b43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526828:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851b27 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b09 expref: 937 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526853:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b09 expref: 936 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.526866:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb45539c100) 00010000:00010000:0.0:1782487582.526872:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.526878:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54800, rc 0) 00000100:00100000:0.0:1782487582.526906:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:293375:x1869066293779328:12345-192.168.202.21@tcp:101:rm.500 Request processed in 599us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.526919:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25412 00000100:00100000:0.0:1782487582.526942:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7209948431911 time 7209948331911 state 0x1 ref 4 00000100:00100000:0.0:1782487582.526960:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+935:293382:x1869066293779456:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.526969:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.526981:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851b5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474b10 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527011:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527031:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527048:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527067:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527076:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527084:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527152:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527161:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527173:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.527191:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xa9f:0x0]: returning size 0 00000004:00200000:0.0:1782487582.527195:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.527206:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527218:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527226:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527249:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527256:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527263:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.527268:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527286:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527300:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.527305:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.527311:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527328:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180600/0x66475b4e8b851b66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527342:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527348:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527355:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527362:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547181c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.527367:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527375:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527386:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb46f434200) 00010000:00010000:0.0:1782487582.527388:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.527392:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527399:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181c00/0x66475b4e8b851b6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527428:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55919c600/0x66475b4e8b851b5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b10 expref: 936 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527454:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180a00/0x66475b4e8b851b74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xa9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b10 expref: 935 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527462:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9f:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:0.0:1782487582.527465:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.527468:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547180a00, rc 0) 00000100:00100000:0.0:1782487582.527499:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:293382:x1869066293779456:12345-192.168.202.21@tcp:101:rm.500 Request processed in 541us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.527519:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25414 00000100:00100000:0.0:1782487582.527658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.527692:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293780096 00000100:00100000:0.0:1782487582.527697:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293780096 00000100:00100000:0.0:1782487582.527732:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1004 00000100:00100000:0.0:1782487582.527743:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:2362:x1869066293780096:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.527762:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.527773:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851b9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474b25 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527799:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527808:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527818:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527834:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527852:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527862:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527935:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527950:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.527972:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.527997:0:190302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa3:0x0]: returning size 0 00000004:00200000:0.0:1782487582.528002:0:190302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.528014:0:190302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528031:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528047:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528062:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528072:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528081:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547181200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.528087:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528096:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528109:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.528112:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.528116:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528123:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547181200/0x66475b4e8b851ba5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528151:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528159:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528173:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528183:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578dea200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.528191:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528200:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528210:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb46f434800) 00010000:00010000:0.0:1782487582.528213:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.528216:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528223:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea200/0x66475b4e8b851bac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528383:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547180c00/0x66475b4e8b851b9e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b25 expref: 937 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528399:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b851bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b25 expref: 936 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.528413:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434f00) 00010000:00010000:0.0:1782487582.528416:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.528419:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45019bc00, rc 0) 00000100:00100000:0.0:1782487582.528460:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:2362:x1869066293780096:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 719us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.528468:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1004 00010000:00010000:0.0:1782487582.529524:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529541:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529549:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529556:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.529561:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529568:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529580:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa6:0x0].0x0 (ffff9cb45539ca00) 00010000:00010000:0.0:1782487582.529583:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.529587:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.529594:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851b7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.531037:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293780480 00000100:00100000:0.0:1782487582.531044:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293780480 00000100:00100000:0.0:1782487582.531090:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293780608 00000100:00100000:0.0:1782487582.531094:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293780608 00000100:00100000:0.0:1782487582.531138:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293780352 00000100:00100000:0.0:1782487582.531142:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293780352 00000100:00100000:0.0:1782487582.531179:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1078 00000100:00100000:0.0:1782487582.531191:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+938:2362:x1869066293780608:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.531201:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.531218:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b851b58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b17 expref: 938 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.531247:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa0:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:0.0:1782487582.531255:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.531299:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:2362:x1869066293780608:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.531316:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1078 00000100:00100000:0.0:1782487582.531339:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1079 00000100:00100000:0.0:1782487582.531364:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+935:2363:x1869066293780352:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.531374:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.531390:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b851b51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xa9e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b09 expref: 935 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.531406:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xa9e:0x0].0x0 (ffff9cb45539c100) 00010000:00010000:0.0:1782487582.531411:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.531442:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+934:2363:x1869066293780352:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 92us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.531453:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1079 00000100:00100000:0.0:1782487582.532433:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293780736 00000100:00100000:0.0:1782487582.532438:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293780736 00000100:00100000:0.0:1782487582.532530:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1080 00000100:00100000:0.0:1782487582.532541:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+935:2361:x1869066293780736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.532551:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.532564:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b851b97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b1e expref: 935 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.532580:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa1:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:0.0:1782487582.532584:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.532634:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+934:2361:x1869066293780736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 96us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.532643:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1080 00000100:00100000:0.0:1782487582.534060:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293781248 00000100:00100000:0.0:1782487582.534066:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293781248 00000100:00100000:0.0:1782487582.534103:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15285 00000100:00100000:0.0:1782487582.534114:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+189:2360:x1869066293781248:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.534390:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+190:2360:x1869066293781248:12345-192.168.202.21@tcp:2:touch.500 Request processed in 277us (355us total) trans 8589940373 rc 0/0 00000100:00100000:0.0:1782487582.534405:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15285 00000100:00100000:0.0:1782487582.535449:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293781760 00000100:00100000:0.0:1782487582.535454:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293781760 00000100:00100000:0.0:1782487582.535493:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5457 00000100:00100000:0.0:1782487582.535503:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+936:293395:x1869066293781760:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.535745:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+938:293395:x1869066293781760:12345-192.168.202.21@tcp:35:touch.500 Request processed in 243us (327us total) trans 8589955670 rc 0/0 00000100:00100000:0.0:1782487582.535755:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5457 00010000:00010000:0.0:1782487582.535932:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.535943:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.535953:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.535961:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.535967:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.535979:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.535998:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb45539c600) 00010000:00010000:0.0:1782487582.536002:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.536007:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.536013:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b851bcf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537659:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537668:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537676:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537682:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.537686:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537693:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537705:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa7:0x0].0x0 (ffff9cb45539c300) 00010000:00010000:0.0:1782487582.537708:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.537713:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.537719:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587800/0x66475b4e8b851be4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538201:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538210:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538218:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538224:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.538228:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538255:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538267:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb45539ca00) 00010000:00010000:0.0:1782487582.538270:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.538274:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.538282:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851bf9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.541178:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293782528 00000100:00100000:0.0:1782487582.541186:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293782528 00000100:00100000:0.0:1782487582.541249:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15286 00000100:00100000:0.0:1782487582.541264:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+170:2360:x1869066293782528:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.541541:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+171:2360:x1869066293782528:12345-192.168.202.21@tcp:2:touch.500 Request processed in 280us (396us total) trans 8589939676 rc 0/0 00000100:00100000:0.0:1782487582.541550:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15286 00010000:00010000:0.0:1782487582.544768:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544778:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544786:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544798:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.544804:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544812:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544826:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb546b6fc00) 00010000:00010000:0.0:1782487582.544830:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.544834:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544841:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b851c23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544889:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544897:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544904:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544910:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.544914:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544922:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544932:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa8:0x0].0x0 (ffff9cb5588ee300) 00010000:00010000:0.0:1782487582.544935:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.544939:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.544945:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b851c38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546500:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546509:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546517:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546524:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.546528:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546536:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546552:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa9:0x0].0x0 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.546556:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.546560:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.546566:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586000/0x66475b4e8b851c46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.548814:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293784448 00000100:00100000:0.0:1782487582.548822:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293784448 00000100:00100000:0.0:1782487582.548870:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5459 00000100:00100000:0.0:1782487582.548882:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+943:293383:x1869066293784448:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.549152:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+944:293383:x1869066293784448:12345-192.168.202.21@tcp:35:touch.500 Request processed in 271us (1219us total) trans 8589955678 rc 0/0 00000100:00100000:0.0:1782487582.549161:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5459 00010000:00010000:0.0:1782487582.549761:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549771:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549778:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549783:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.549788:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549795:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549808:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb4b6109000) 00010000:00010000:0.0:1782487582.549812:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.549816:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.549822:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b851c54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552031:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552046:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552053:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552059:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.552063:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552071:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552084:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4b6109a00) 00010000:00010000:0.0:1782487582.552087:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.552091:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.552098:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b851c7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.552557:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293784832 00000100:00100000:0.0:1782487582.552563:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293784832 00000100:00100000:0.0:1782487582.552636:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15288 00000100:00100000:0.0:1782487582.552648:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+171:2360:x1869066293784832:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.552934:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+172:2360:x1869066293784832:12345-192.168.202.21@tcp:2:touch.500 Request processed in 286us (429us total) trans 8589939677 rc 0/0 00000100:00100000:0.0:1782487582.552945:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15288 00010000:00010000:0.0:1782487582.554502:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554510:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554518:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554525:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.554530:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554538:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554551:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaaa:0x0].0x0 (ffff9cb4b6109800) 00010000:00010000:0.0:1782487582.554555:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.554558:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.554565:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b851c93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556513:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556523:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556530:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556539:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.556543:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556550:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556560:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4b6109600) 00010000:00010000:0.0:1782487582.556564:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.556567:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.556572:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b851ca1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.563165:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293786368 00000100:00100000:0.0:1782487582.563171:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293786368 00000100:00100000:0.0:1782487582.563214:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5461 00000100:00100000:0.0:1782487582.563228:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+576:293389:x1869066293786368:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.563488:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+524:293389:x1869066293786368:12345-192.168.202.21@tcp:35:touch.500 Request processed in 264us (1308us total) trans 8589955684 rc 0/0 00000100:00100000:0.0:1782487582.563498:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5461 00010000:00010000:0.0:1782487582.563530:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563540:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563576:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563596:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.563604:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563643:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563670:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb45a514600) 00010000:00010000:0.0:1782487582.563676:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.563682:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.563693:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653ce00/0x66475b4e8b851cc4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.563731:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299124096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.563770:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.563798:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e7cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299124608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.563830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.563860:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782487582.563869:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299123712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.563899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.563929:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299124224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.563957:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.564001:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299124096 00000100:00100000:0.0:1782487582.564005:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299124096 00000100:00100000:0.0:1782487582.564035:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299124608 00000100:00100000:0.0:1782487582.564038:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299124608 00000100:00100000:0.0:1782487582.564064:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299123712 00000100:00100000:0.0:1782487582.564067:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299123712 00000100:00100000:0.0:1782487582.564101:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299124224 00000100:00100000:0.0:1782487582.564105:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299124224 00000100:00100000:0.0:1782487582.564140:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15295 00000100:00100000:0.0:1782487582.564154:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299124608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.564172:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5904 count 1 00010000:00010000:0.0:1782487582.564190:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564206:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564228:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1710:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487582.564248:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.564257:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564288:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564301:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.564321:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54815f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299125376:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.564362:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.564388:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15296 00000100:00100000:0.0:1782487582.564398:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299123712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.564411:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5894 count 1 00010000:00010000:0.0:1782487582.564424:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564436:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b841931 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a470094 expref: 171 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564443:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1706:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487582.564446:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.564450:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564471:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b841931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470094 expref: 171 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564481:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b841931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470094 expref: 171 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.564492:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54815dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299125504:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.564532:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.564558:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1782487582.564569:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299124224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.564582:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5899 count 1 00010000:00010000:0.0:1782487582.564595:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564625:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 171 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564634:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170b:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487582.564637:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.564642:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564664:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 171 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.564676:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 171 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.564689:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299125632:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.564743:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.565984:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299125632:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.566019:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.566066:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54815f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299125376:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.566090:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.566134:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54815dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299125504:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.566159:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.566460:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782487582.566474:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299125760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.566511:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.566582:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4503e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299126144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.566643:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.566676:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782487582.566687:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299126272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.566721:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.566986:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787008 00000100:00100000:0.0:1782487582.566994:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787008 00010000:00010000:0.0:1782487582.567023:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b841d59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470349 expref: 172 pid: 190930 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.567057:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787520 00000100:00100000:0.0:1782487582.567063:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787520 00010000:00010000:0.0:1782487582.567085:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e0f2c0d/0x66475b4e8b84248a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47047d expref: 164 pid: 213221 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.567124:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787904 00000100:00100000:0.0:1782487582.567130:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787904 00010000:00010000:0.0:1782487582.567149:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b841931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1706:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470094 expref: 173 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.567186:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787264 00000100:00100000:0.0:1782487582.567191:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787264 00010000:00010000:0.0:1782487582.567209:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 174 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.567227:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787648 00000100:00100000:0.0:1782487582.567246:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787648 00010000:00010000:0.0:1782487582.567264:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005720ad4d/0x66475b4e8b841e01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1708:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470350 expref: 175 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.567296:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5729 00000100:00100000:0.0:1782487582.567306:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+175:2362:x1869066293787008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.567320:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.567327:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b841d59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470349 expref: 175 pid: 190930 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567349:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b841d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470349 expref: 175 pid: 190930 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567374:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b841d59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1709:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470349 expref: 175 pid: 190930 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567404:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.567413:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.567423:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567440:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567479:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.567510:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+174:2362:x1869066293787008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 202us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.567521:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5729 00000100:00100000:0.0:1782487582.567587:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5732 00000100:00100000:0.0:1782487582.567603:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+173:2362:x1869066293787264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.567854:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.567866:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 171 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567897:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 170 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567936:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b841e6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x170b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47036c expref: 170 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.567987:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.567995:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.568000:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568018:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568050:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.568070:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e083800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+168:2362:x1869066293787264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 472us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.568085:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5732 00010000:00010000:0.0:1782487582.568119:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568126:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568132:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568137:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568152:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.568367:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3316:x1869066299124224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3801us (4409us total) trans 8589939679 rc 0/0 00000100:00100000:0.0:1782487582.568379:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000004:00080000:0.0:1782487582.568420:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472811500/2, rc 0, transno 8589939678 00000100:00100000:0.0:1782487582.568434:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299123712:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.568451:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472810380/2, rc 0, transno 8589939679 00000100:00100000:0.0:1782487582.568456:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299124224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.568545:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782487582.568559:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299128448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.568637:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.568672:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472810a80/2, rc 0, transno 8589939680 00000100:00100000:0.0:1782487582.568683:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299124096:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.568967:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782487582.568977:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.568988:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.568992:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569003:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569032:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569067:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b851d03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569105:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.569114:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569131:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.569138:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569166:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569197:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569223:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099215138/0x66475b4e8b851d0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x170b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569261:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.569266:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006acfc768/0x66475b4e8b851cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569278:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.569286:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006acfc768/0x66475b4e8b851cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569303:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006acfc768/0x66475b4e8b851cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569318:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006acfc768/0x66475b4e8b851cf5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569328:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006acfc768/0x66475b4e8b851cf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569360:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.569365:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d56f1cf/0x66475b4e8b851cee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x170d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569385:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d87200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.569393:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d56f1cf/0x66475b4e8b851cee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x170d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569408:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d56f1cf/0x66475b4e8b851cee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x170d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569434:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d56f1cf/0x66475b4e8b851cee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x170d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569447:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d56f1cf/0x66475b4e8b851cee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x170d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569475:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.569483:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569498:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.569506:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569533:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569555:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569571:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f9af04/0x66475b4e8b851ce0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.569596:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.569601:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.569638:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.569890:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787136 00000100:00100000:0.0:1782487582.569896:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787136 00010000:00010000:0.0:1782487582.569921:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b841cb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470342 expref: 168 pid: 213210 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.569945:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787776 00000100:00100000:0.0:1782487582.569949:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787776 00010000:00010000:0.0:1782487582.569964:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.569982:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293787392 00000100:00100000:0.0:1782487582.569985:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293787392 00010000:00010000:0.0:1782487582.569997:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b8420f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47038f expref: 169 pid: 213210 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.570030:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5734 00000100:00100000:0.0:1782487582.570039:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+169:2361:x1869066293787136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.570047:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.570050:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b841cb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470342 expref: 169 pid: 213210 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570062:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b841cb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x170a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470342 expref: 169 pid: 213210 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570077:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b841cb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x170a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470342 expref: 169 pid: 213210 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570091:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570094:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570098:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008749ba9/0x66475b4e8b851cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570106:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008749ba9/0x66475b4e8b851cd9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x170a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570127:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.570145:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb575cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+168:2361:x1869066293787136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 106us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.570155:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5734 00000100:00100000:0.0:1782487582.570173:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293788032 00000100:00100000:0.0:1782487582.570178:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293788032 00010000:00010000:0.0:1782487582.570192:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004be85840/0x66475b4e8b842a4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1738:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470636 expref: 152 pid: 213211 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.570217:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293788288 00000100:00100000:0.0:1782487582.570220:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293788288 00010000:00010000:0.0:1782487582.570248:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b842ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470652 expref: 153 pid: 213384 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.570265:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293788160 00000100:00100000:0.0:1782487582.570269:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293788160 00010000:00010000:0.0:1782487582.570284:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0592c3/0x66475b4e8b843dea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470993 expref: 154 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.570306:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5735 00000100:00100000:0.0:1782487582.570317:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+163:2361:x1869066293787776:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.570325:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.570335:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570359:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570389:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b842818 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1710:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470587 expref: 163 pid: 213223 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570409:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570416:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570423:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570449:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570472:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.570496:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+162:2361:x1869066293787776:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.570525:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5735 00000100:00100000:0.0:1782487582.570544:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5737 00000100:00100000:0.0:1782487582.570555:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2363:x1869066293788032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.570570:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.570580:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004be85840/0x66475b4e8b842a4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470636 expref: 154 pid: 213211 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570636:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004be85840/0x66475b4e8b842a4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470636 expref: 154 pid: 213211 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570652:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570656:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.570661:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000decfc18d/0x66475b4e8b851d11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570676:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000decfc18d/0x66475b4e8b851d11 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1738:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570701:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.570723:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2363:x1869066293788032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.570741:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5737 00000100:00100000:0.0:1782487582.570759:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5739 00000100:00100000:0.0:1782487582.570769:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+153:2363:x1869066293788160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.570791:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.570803:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec0592c3/0x66475b4e8b843dea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470993 expref: 152 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570828:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec0592c3/0x66475b4e8b843dea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470993 expref: 152 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570872:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.570897:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2363:x1869066293788160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.570912:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5739 00010000:00010000:0.0:1782487582.570937:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570951:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570972:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570977:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b851cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.570998:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.571120:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3316:x1869066299124608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6971us (7291us total) trans 8589939685 rc 0/0 00000100:00100000:0.0:1782487582.571137:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15295 00000004:00080000:0.0:1782487582.571399:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44c31d880/2, rc 0, transno 8589940376 00000100:00100000:0.0:1782487582.571417:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299125888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.571516:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb455fa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299127296:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.571857:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb455fa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299127424:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.571882:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df122fb8/0x66475b4e8b851d26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x173c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.571952:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.571965:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.571973:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.571980:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.571984:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.571991:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572006:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb558966800) 00010000:00010000:0.0:1782487582.572011:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.572015:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572021:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b851d50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572103:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572113:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572124:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572143:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.572148:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572169:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572185:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb5588eee00) 00010000:00010000:0.0:1782487582.572191:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.572196:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.572205:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851d88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.576507:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293788544 00000100:00100000:0.0:1782487582.576514:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293788544 00010000:00010000:0.0:1782487582.576538:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b843d57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470938 expref: 149 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.576576:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789056 00000100:00100000:0.0:1782487582.576581:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789056 00010000:00010000:0.0:1782487582.576598:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009952dddf/0x66475b4e8b842a10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1711:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4705f0 expref: 162 pid: 195192 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.576634:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789568 00000100:00100000:0.0:1782487582.576641:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789568 00010000:00010000:0.0:1782487582.576660:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b84362d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707d3 expref: 194 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.576695:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5740 00000100:00100000:0.0:1782487582.576706:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+194:2362:x1869066293788416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.576722:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.576730:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b84359a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47079b expref: 194 pid: 213224 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.576748:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b84359a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47079b expref: 194 pid: 213224 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.576772:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b84359a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x173e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47079b expref: 194 pid: 213224 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.576788:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x173e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.576793:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x173e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.576801:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ff531f8/0x66475b4e8b851d1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x173e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.576818:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ff531f8/0x66475b4e8b851d1f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x173e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.576841:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.576885:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+194:2362:x1869066293788416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.576901:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5740 00000100:00100000:0.0:1782487582.576926:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789184 00000100:00100000:0.0:1782487582.576932:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789184 00010000:00010000:0.0:1782487582.576951:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000699670f/0x66475b4e8b843577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470794 expref: 194 pid: 213224 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.576970:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789440 00000100:00100000:0.0:1782487582.576973:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789440 00010000:00010000:0.0:1782487582.576988:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b843626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707c5 expref: 195 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.577017:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5742 00000100:00100000:0.0:1782487582.577027:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+195:2363:x1869066293788800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.577038:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.577047:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdb90677/0x66475b4e8b844235 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a50 expref: 195 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577062:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdb90677/0x66475b4e8b844235 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a50 expref: 195 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577094:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb90677/0x66475b4e8b844235 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a50 expref: 195 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577110:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.577115:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.577126:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cb383ad/0x66475b4e8b851d2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577137:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb383ad/0x66475b4e8b851d2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577162:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.577186:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+194:2363:x1869066293788800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.577193:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5742 00000100:00100000:0.0:1782487582.577219:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789696 00000100:00100000:0.0:1782487582.577225:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789696 00010000:00010000:0.0:1782487582.577256:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b843db9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47097e expref: 149 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.577277:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293789952 00000100:00100000:0.0:1782487582.577281:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293789952 00010000:00010000:0.0:1782487582.577299:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a0550fe/0x66475b4e8b842aaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47063d expref: 164 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.577331:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293790720 00000100:00100000:0.0:1782487582.577336:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293790720 00010000:00010000:0.0:1782487582.577355:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006db44b66/0x66475b4e8b843b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47089e expref: 165 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.577389:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5744 00000100:00100000:0.0:1782487582.577397:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+149:2363:x1869066293789312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.577409:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.577416:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b843df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47099a expref: 149 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577432:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b843df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47099a expref: 149 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577452:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b843df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47099a expref: 149 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577479:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.577507:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+148:2363:x1869066293789312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 109us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.577518:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5744 00000100:00100000:0.0:1782487582.577538:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5746 00000100:00100000:0.0:1782487582.577552:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+166:2363:x1869066293789824:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.577562:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.577573:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b41a173/0x66475b4e8b8424d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470492 expref: 166 pid: 213213 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577592:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b41a173/0x66475b4e8b8424d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x170e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470492 expref: 166 pid: 213213 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577870:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b41a173/0x66475b4e8b8424d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x170e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470492 expref: 164 pid: 213213 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577908:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.577916:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.577926:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000751e9167/0x66475b4e8b851d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577951:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000751e9167/0x66475b4e8b851d5e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x170e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.577975:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.578001:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+163:2363:x1869066293789824:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 455us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.578011:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5746 00000100:00100000:0.0:1782487582.578030:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5749 00000100:00100000:0.0:1782487582.578043:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+162:2363:x1869066293788928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.578057:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.578063:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049789c10/0x66475b4e8b8424ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x170f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4704a7 expref: 162 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578077:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049789c10/0x66475b4e8b8424ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x170f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4704a7 expref: 162 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578096:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049789c10/0x66475b4e8b8424ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x170f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4704a7 expref: 162 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578127:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578135:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x170f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578146:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b851d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x170f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578161:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b851d65 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x170f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578187:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.578212:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+161:2363:x1869066293788928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.578231:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5749 00000100:00100000:0.0:1782487582.578263:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5751 00000100:00100000:0.0:1782487582.578275:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+189:2363:x1869066293789440:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.578287:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.578297:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b843626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707c5 expref: 189 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578329:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b843626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707c5 expref: 188 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578360:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b843626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707c5 expref: 188 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578395:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x173f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578405:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x173f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578413:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000999c44c7/0x66475b4e8b851d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x173f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578437:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999c44c7/0x66475b4e8b851d42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x173f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578470:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.578492:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+187:2363:x1869066293789440:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.578501:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5751 00000100:00100000:0.0:1782487582.578526:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5753 00000100:00100000:0.0:1782487582.578536:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+160:2363:x1869066293789952:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.578548:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.578557:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a0550fe/0x66475b4e8b842aaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47063d expref: 160 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578576:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a0550fe/0x66475b4e8b842aaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47063d expref: 160 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578628:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a0550fe/0x66475b4e8b842aaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1712:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47063d expref: 160 pid: 192482 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578662:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578670:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578675:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7947029/0x66475b4e8b851d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578683:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7947029/0x66475b4e8b851d8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1712:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578716:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.578736:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+159:2363:x1869066293789952:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.578753:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5753 00000100:00100000:0.0:1782487582.578768:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5755 00000100:00100000:0.0:1782487582.578780:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+158:2362:x1869066293790720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.578790:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.578798:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006db44b66/0x66475b4e8b843b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47089e expref: 158 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578810:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006db44b66/0x66475b4e8b843b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x171b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47089e expref: 158 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578827:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db44b66/0x66475b4e8b843b04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x171b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47089e expref: 158 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578860:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578865:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.578876:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ace12d8d/0x66475b4e8b851db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x171b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578906:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace12d8d/0x66475b4e8b851db2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x171b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.578943:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.578965:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442723100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+157:2362:x1869066293790720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 185us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.578984:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5755 00000100:00100000:0.0:1782487582.579573:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293790976 00000100:00100000:0.0:1782487582.579579:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293790976 00010000:00010000:0.0:1782487582.579600:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aca556b9/0x66475b4e8b844243 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a65 expref: 185 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.579656:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293791104 00000100:00100000:0.0:1782487582.579660:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293791104 00010000:00010000:0.0:1782487582.579677:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b84424a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a57 expref: 186 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.579698:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293790848 00000100:00100000:0.0:1782487582.579701:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293790848 00010000:00010000:0.0:1782487582.579717:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b843dc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470985 expref: 155 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.579741:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5757 00000100:00100000:0.0:1782487582.579750:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+186:2360:x1869066293790976:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.579759:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.579764:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000aca556b9/0x66475b4e8b844243 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a65 expref: 186 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.579776:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aca556b9/0x66475b4e8b844243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a65 expref: 186 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.579793:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1741:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.579796:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.579801:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a7e59ca/0x66475b4e8b851dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.579808:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7e59ca/0x66475b4e8b851dc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.579823:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.579850:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+186:2360:x1869066293790976:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.579866:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5757 00000100:00100000:0.0:1782487582.579909:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293791232 00000100:00100000:0.0:1782487582.579912:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293791232 00010000:00010000:0.0:1782487582.579931:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fafaadda/0x66475b4e8b843603 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707b0 expref: 166 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.579969:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5758 00000100:00100000:0.0:1782487582.579983:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+185:2362:x1869066293791104:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.579997:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.580004:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b84424a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a57 expref: 185 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580031:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b84424a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a57 expref: 185 pid: 213227 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580046:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1740:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.580050:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.580055:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580074:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580106:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.580139:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+185:2362:x1869066293791104:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.580152:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5758 00000100:00100000:0.0:1782487582.580175:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5759 00000100:00100000:0.0:1782487582.580185:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+155:2362:x1869066293790848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.580204:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.580211:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b843dc7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470985 expref: 155 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580229:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b843dc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470985 expref: 155 pid: 213226 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580278:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.580302:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+155:2362:x1869066293790848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 118us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.580320:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5759 00000100:00100000:0.0:1782487582.580342:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5760 00000100:00100000:0.0:1782487582.580354:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2362:x1869066293791232:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.580374:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.580382:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000fafaadda/0x66475b4e8b843603 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707b0 expref: 166 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580401:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fafaadda/0x66475b4e8b843603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707b0 expref: 166 pid: 190931 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580419:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1716:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.580424:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.580430:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580456:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580471:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.580494:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2362:x1869066293791232:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 143us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.580510:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5760 00010000:00010000:0.0:1782487582.580664:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.580672:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580692:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653d600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.580698:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580708:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580726:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580734:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081be75aa/0x66475b4e8b851dc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580761:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.580765:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.580769:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.580828:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb449ace680/2, rc 0, transno 8589939690 00000100:00100000:0.0:1782487582.580843:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb449ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299129856:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.580858:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491adf80/2, rc 0, transno 8589940381 00000100:00100000:0.0:1782487582.580872:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299126400:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.580887:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb559179c00/2, rc 0, transno 8589940380 00000100:00100000:0.0:1782487582.580894:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb559179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299126528:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.580908:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44c31c380/2, rc 0, transno 8589940379 00000100:00100000:0.0:1782487582.580917:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299126016:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487582.580957:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.580962:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580970:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.580974:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.580995:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581020:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581036:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216cb999/0x66475b4e8b851db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581058:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.581060:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.581063:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.581222:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581306:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581314:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581325:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.581329:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581337:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581352:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb57fd34900) 00010000:00010000:0.0:1782487582.581356:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.581360:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581366:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffe00/0x66475b4e8b851ddc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.581595:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293792000 00000100:00100000:0.0:1782487582.581600:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293792000 00010000:00010000:0.0:1782487582.581700:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b843d50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47092a expref: 154 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.581737:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293791872 00000100:00100000:0.0:1782487582.581742:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293791872 00010000:00010000:0.0:1782487582.581760:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007476b187/0x66475b4e8b843634 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e8 expref: 165 pid: 213220 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.581784:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293792640 00000100:00100000:0.0:1782487582.581788:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293792640 00010000:00010000:0.0:1782487582.581802:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8435d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707a9 expref: 166 pid: 213384 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.581829:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5761 00000100:00100000:0.0:1782487582.581837:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2363:x1869066293792000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.581846:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.581855:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b843d50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47092a expref: 154 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581869:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b843d50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47092a expref: 154 pid: 213228 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.581900:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.581922:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2363:x1869066293792000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.581940:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5761 00000100:00100000:0.0:1782487582.581964:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5762 00000100:00100000:0.0:1782487582.581978:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2363:x1869066293791872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.581991:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.581997:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000007476b187/0x66475b4e8b843634 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e8 expref: 166 pid: 213220 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582012:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007476b187/0x66475b4e8b843634 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e8 expref: 166 pid: 213220 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582038:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.582064:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2363:x1869066293791872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.582072:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5762 00000100:00100000:0.0:1782487582.582092:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5763 00000100:00100000:0.0:1782487582.582102:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+165:2363:x1869066293792640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.582111:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.582119:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8435d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707a9 expref: 165 pid: 213384 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582139:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8435d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707a9 expref: 165 pid: 213384 timeout: 7309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582152:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1715:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.582157:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.582165:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027cd3041/0x66475b4e8b851de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582174:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027cd3041/0x66475b4e8b851de3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1715:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.582186:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.582208:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+165:2363:x1869066293792640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 106us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.582215:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5763 00010000:00010000:0.0:1782487582.583155:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583173:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583190:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583205:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.583213:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583227:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583250:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb57fd34d00) 00010000:00010000:0.0:1782487582.583254:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.583258:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583265:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b851e06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583299:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583308:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583314:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583319:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.583325:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583335:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583349:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa65:0x0].0x0 (ffff9cb45a514800) 00010000:00010000:0.0:1782487582.583352:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.583356:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.583367:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b851e1b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.587988:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293792896 00000100:00100000:0.0:1782487582.587994:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293792896 00010000:00010000:0.0:1782487582.588018:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c701a20c/0x66475b4e8b8435d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707be expref: 163 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.588046:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5764 00000100:00100000:0.0:1782487582.588055:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+163:2362:x1869066293792896:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.588066:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.588072:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c701a20c/0x66475b4e8b8435d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707be expref: 163 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588086:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c701a20c/0x66475b4e8b8435d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707be expref: 163 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588103:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c701a20c/0x66475b4e8b8435d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707be expref: 163 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588117:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.588149:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+162:2362:x1869066293792896:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.588158:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5764 00000100:00100000:0.0:1782487582.588205:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293793152 00000100:00100000:0.0:1782487582.588209:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293793152 00010000:00010000:0.0:1782487582.588226:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b84423c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a5e expref: 183 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.588268:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5765 00000100:00100000:0.0:1782487582.588281:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+183:2362:x1869066293793152:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.588290:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.588297:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b84423c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a5e expref: 183 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588313:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b84423c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a5e expref: 183 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588328:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.588333:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.588337:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b851e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588351:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b851e37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588369:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.588395:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+183:2362:x1869066293793152:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.588403:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5765 00000100:00100000:0.0:1782487582.588420:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293792768 00000100:00100000:0.0:1782487582.588425:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293792768 00010000:00010000:0.0:1782487582.588443:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001962cc79/0x66475b4e8b843dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47098c expref: 153 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.588470:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293793024 00000100:00100000:0.0:1782487582.588475:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293793024 00010000:00010000:0.0:1782487582.588496:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b84463a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470b6f expref: 146 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.588518:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293793280 00000100:00100000:0.0:1782487582.588522:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293793280 00010000:00010000:0.0:1782487582.588539:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029fdb30b/0x66475b4e8b8447ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bae expref: 147 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.588559:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5766 00000100:00100000:0.0:1782487582.588570:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+153:2362:x1869066293792768:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.588579:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.588585:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001962cc79/0x66475b4e8b843dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47098c expref: 153 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588597:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001962cc79/0x66475b4e8b843dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47098c expref: 153 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588639:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001962cc79/0x66475b4e8b843dc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47098c expref: 153 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588656:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.588691:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2362:x1869066293792768:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.588707:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5766 00000100:00100000:0.0:1782487582.588731:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5768 00000100:00100000:0.0:1782487582.588742:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2362:x1869066293793280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.588760:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.588767:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029fdb30b/0x66475b4e8b8447ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bae expref: 147 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588783:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029fdb30b/0x66475b4e8b8447ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bae expref: 147 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588810:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.588816:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.588826:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004620a504/0x66475b4e8b851e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588837:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004620a504/0x66475b4e8b851e3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.588862:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.588888:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2362:x1869066293793280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 147us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.588902:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5768 00000100:00100000:0.0:1782487582.589802:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794048 00000100:00100000:0.0:1782487582.589808:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794048 00010000:00010000:0.0:1782487582.589831:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b843df8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4709a1 expref: 152 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.589857:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794304 00000100:00100000:0.0:1782487582.589860:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794304 00010000:00010000:0.0:1782487582.589879:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b84363b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e1 expref: 162 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.589907:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293793920 00000100:00100000:0.0:1782487582.589910:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293793920 00010000:00010000:0.0:1782487582.589926:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6018a97/0x66475b4e8b843618 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707da expref: 163 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.589955:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794176 00000100:00100000:0.0:1782487582.589959:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794176 00010000:00010000:0.0:1782487582.589975:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064e97692/0x66475b4e8b8435f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707cc expref: 164 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.589992:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5769 00000100:00100000:0.0:1782487582.590001:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2363:x1869066293794048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.590010:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.590015:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b843df8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4709a1 expref: 152 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590026:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b843df8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4709a1 expref: 152 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590042:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.590075:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2363:x1869066293794048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.590083:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5769 00000100:00100000:0.0:1782487582.590101:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5770 00000100:00100000:0.0:1782487582.590115:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+164:2363:x1869066293794304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.590125:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.590132:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b84363b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e1 expref: 164 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590145:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b84363b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707e1 expref: 164 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590169:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.590174:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.590184:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000599533c4/0x66475b4e8b851e29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590197:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000599533c4/0x66475b4e8b851e29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1717:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590223:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.590264:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+164:2363:x1869066293794304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 152us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.590272:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5770 00000100:00100000:0.0:1782487582.590292:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5771 00000100:00100000:0.0:1782487582.590306:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+163:2363:x1869066293793920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.590320:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.590328:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6018a97/0x66475b4e8b843618 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707da expref: 163 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590348:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6018a97/0x66475b4e8b843618 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707da expref: 163 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.590368:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.590401:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+163:2363:x1869066293793920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 96us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.590415:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5771 00000100:00100000:0.0:1782487582.590465:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794560 00000100:00100000:0.0:1782487582.590471:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794560 00010000:00010000:0.0:1782487582.590492:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b84453e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470b29 expref: 152 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590507:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794816 00000100:00100000:0.0:1782487582.590513:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794816 00010000:00010000:0.0:1782487582.590529:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b844d5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d6e expref: 145 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590552:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795072 00000100:00100000:0.0:1782487582.590557:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795072 00010000:00010000:0.0:1782487582.590576:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000339ae679/0x66475b4e8b844220 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a3b expref: 183 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590600:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795328 00000100:00100000:0.0:1782487582.590604:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795328 00010000:00010000:0.0:1782487582.590640:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b8442c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1719:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470aab expref: 163 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590680:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795584 00000100:00100000:0.0:1782487582.590686:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795584 00010000:00010000:0.0:1782487582.590707:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e353ab61/0x66475b4e8b8442c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ab2 expref: 164 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590734:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794688 00000100:00100000:0.0:1782487582.590740:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794688 00010000:00010000:0.0:1782487582.590760:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8442a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470aa4 expref: 165 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590799:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293794944 00000100:00100000:0.0:1782487582.590805:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293794944 00010000:00010000:0.0:1782487582.590825:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b844219 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a34 expref: 184 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590856:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795200 00000100:00100000:0.0:1782487582.590862:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795200 00010000:00010000:0.0:1782487582.590884:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070bc5441/0x66475b4e8b844212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4709ee expref: 165 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590906:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795456 00000100:00100000:0.0:1782487582.590911:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795456 00010000:00010000:0.0:1782487582.590927:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ef67995/0x66475b4e8b844990 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1748:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c48 expref: 145 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590944:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795712 00000100:00100000:0.0:1782487582.590947:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795712 00010000:00010000:0.0:1782487582.590963:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b844227 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a42 expref: 166 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.590981:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5772 00000100:00100000:0.0:1782487582.590990:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2363:x1869066293794176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.591000:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.591005:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064e97692/0x66475b4e8b8435f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707cc expref: 166 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591016:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064e97692/0x66475b4e8b8435f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4707cc expref: 166 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591030:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591034:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591038:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b851e22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591057:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b851e22 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1718:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591078:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.591117:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2363:x1869066293794176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.591132:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5772 00000100:00100000:0.0:1782487582.591161:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5773 00000100:00100000:0.0:1782487582.591176:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2362:x1869066293794560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.591185:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.591198:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b84453e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470b29 expref: 152 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591229:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b84453e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x171f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470b29 expref: 152 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591278:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b84453e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x171f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470b29 expref: 152 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591302:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591306:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591317:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b851e45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x171f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591329:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b851e45 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x171f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591353:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.591378:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2362:x1869066293794560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 206us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.591389:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5773 00000100:00100000:0.0:1782487582.591413:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5775 00000100:00100000:0.0:1782487582.591424:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+183:2362:x1869066293795072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.591438:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.591447:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000339ae679/0x66475b4e8b844220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a3b expref: 183 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591470:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000339ae679/0x66475b4e8b844220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a3b expref: 183 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591501:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000339ae679/0x66475b4e8b844220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1745:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a3b expref: 183 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591527:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591534:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.591545:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b851e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591568:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b851e53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591620:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.591650:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+182:2362:x1869066293795072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 228us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.591672:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5775 00000100:00100000:0.0:1782487582.591701:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5778 00000100:00100000:0.0:1782487582.591717:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545575450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+162:2362:x1869066293794688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.591729:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.591738:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8442a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470aa4 expref: 162 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591787:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8442a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470aa4 expref: 162 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.591991:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.592015:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545575450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+162:2362:x1869066293794688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 303us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.592023:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5778 00000100:00100000:0.0:1782487582.592047:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5779 00000100:00100000:0.0:1782487582.592059:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+181:2362:x1869066293794944:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.592071:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.592079:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b844219 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a34 expref: 181 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592107:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b844219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a34 expref: 181 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592136:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.592145:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.592154:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006072c3d2/0x66475b4e8b851e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592167:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006072c3d2/0x66475b4e8b851e4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592210:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.592244:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+181:2362:x1869066293794944:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 174us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.592262:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5779 00000100:00100000:0.0:1782487582.592281:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5781 00000100:00100000:0.0:1782487582.592292:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2362:x1869066293795456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.592306:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.592315:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ef67995/0x66475b4e8b844990 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c48 expref: 144 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592344:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ef67995/0x66475b4e8b844990 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c48 expref: 144 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592362:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.592367:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.592375:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b851e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592397:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b851e68 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1748:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592428:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.592450:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2362:x1869066293795456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.592479:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5781 00010000:00010000:0.0:1782487582.592510:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592522:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592539:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592555:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.592560:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592578:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592595:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaab:0x0].0x0 (ffff9cb57fd34300) 00010000:00010000:0.0:1782487582.592598:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.592602:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.592634:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b851e84 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593169:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593178:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593189:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593195:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.593200:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593213:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593228:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb57fd34b00) 00010000:00010000:0.0:1782487582.593231:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.593247:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593255:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b851ea0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.593329:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293796096 00000100:00100000:0.0:1782487582.593337:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293796096 00010000:00010000:0.0:1782487582.593362:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000501e128d/0x66475b4e8b84422e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a49 expref: 157 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.593400:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293795968 00000100:00100000:0.0:1782487582.593404:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293795968 00010000:00010000:0.0:1782487582.593422:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b844d4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d67 expref: 144 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.593449:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5783 00000100:00100000:0.0:1782487582.593462:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+157:2363:x1869066293796096:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.593472:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.593481:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000501e128d/0x66475b4e8b84422e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x171d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a49 expref: 157 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593498:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000501e128d/0x66475b4e8b84422e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x171d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470a49 expref: 157 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593512:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.593522:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x171d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.593532:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090c6086b/0x66475b4e8b851ea7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x171d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593553:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c6086b/0x66475b4e8b851ea7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x171d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593582:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.593635:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+157:2363:x1869066293796096:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 175us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.593645:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5783 00000100:00100000:0.0:1782487582.593666:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5784 00000100:00100000:0.0:1782487582.593681:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2363:x1869066293795968:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.593698:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.593707:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b844d4f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d67 expref: 144 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593761:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b844d4f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d67 expref: 144 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593780:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.593785:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.593792:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b851e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593821:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b851e8b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x174b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.593850:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.593878:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2363:x1869066293795968:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.593889:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5784 00010000:00010000:0.0:1782487582.594371:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594380:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594393:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594456:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.594461:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594470:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594481:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa66:0x0].0x0 (ffff9cb57fd34400) 00010000:00010000:0.0:1782487582.594487:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.594490:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.594507:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b851ebc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa66:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595393:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595410:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595420:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595426:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456342a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.595429:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595434:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595442:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb57fd34e00) 00010000:00010000:0.0:1782487582.595446:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.595449:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595455:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342a00/0x66475b4e8b851ed1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595569:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595578:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595595:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595600:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7ff200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.595602:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595629:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595638:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaac:0x0].0x0 (ffff9cb45a514a00) 00010000:00010000:0.0:1782487582.595641:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.595644:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.595650:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ff200/0x66475b4e8b851efb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596380:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596391:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596399:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596404:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.596408:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596416:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596433:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb57fd34800) 00010000:00010000:0.0:1782487582.596437:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.596441:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.596447:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b851f09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600776:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600786:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600793:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600799:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7ffe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.600803:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600814:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600831:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa67:0x0].0x0 (ffff9cb45a514900) 00010000:00010000:0.0:1782487582.600835:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.600839:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.600845:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffe00/0x66475b4e8b851f25 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.600908:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293798912 00000100:00100000:0.0:1782487582.600914:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293798912 00000100:00100000:0.0:1782487582.600950:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293799168 00000100:00100000:0.0:1782487582.600955:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293799168 00000100:00100000:0.0:1782487582.600986:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5463 00000100:00100000:0.0:1782487582.601001:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+497:293409:x1869066293798528:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.601166:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+498:293409:x1869066293798528:12345-192.168.202.21@tcp:35:touch.500 Request processed in 168us (349us total) trans 8589955701 rc 0/0 00000100:00100000:0.0:1782487582.601172:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5463 00010000:00010000:0.0:1782487582.602312:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602322:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602330:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602343:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.602346:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602352:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602375:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb57fd34700) 00010000:00010000:0.0:1782487582.602382:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.602388:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602402:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138a00/0x66475b4e8b851f41 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602437:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602454:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602466:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602476:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47c7ffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.602481:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602490:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602503:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaad:0x0].0x0 (ffff9cb45a514d00) 00010000:00010000:0.0:1782487582.602505:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.602508:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.602514:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47c7ffa00/0x66475b4e8b851f56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.604026:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293800064 00000100:00100000:0.0:1782487582.604032:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293800064 00010000:00010000:0.0:1782487582.604055:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca77b3ae/0x66475b4e8b844de9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d91 expref: 141 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.604086:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5785 00000100:00100000:0.0:1782487582.604099:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2362:x1869066293799552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.604110:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.604116:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b844a00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c5d expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604129:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b844a00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c5d expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604155:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b844a00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1722:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c5d expref: 153 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604175:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604180:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604188:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007476b187/0x66475b4e8b851f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604197:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007476b187/0x66475b4e8b851f5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1722:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604217:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.604256:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2362:x1869066293799552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.604264:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5785 00000100:00100000:0.0:1782487582.604300:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5787 00000100:00100000:0.0:1782487582.604312:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2362:x1869066293800064:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.604319:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.604328:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca77b3ae/0x66475b4e8b844de9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d91 expref: 142 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604339:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca77b3ae/0x66475b4e8b844de9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d91 expref: 142 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604360:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca77b3ae/0x66475b4e8b844de9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d91 expref: 142 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604390:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604400:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604411:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604440:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604470:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.604495:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2362:x1869066293800064:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 183us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.604506:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5787 00000100:00100000:0.0:1782487582.604530:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5789 00000100:00100000:0.0:1782487582.604540:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2362:x1869066293799936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.604551:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.604558:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b844d56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d60 expref: 151 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604572:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b844d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d60 expref: 151 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604589:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b844d56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1723:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d60 expref: 151 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604601:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604629:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.604634:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604648:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604671:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.604699:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2362:x1869066293799936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 160us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.604708:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5789 00010000:00010000:0.0:1782487582.604740:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604747:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604751:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604756:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558610a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.604761:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604773:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604789:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb57fd34c00) 00010000:00010000:0.0:1782487582.604792:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.604796:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604809:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610a00/0x66475b4e8b851f6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604833:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604840:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604845:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604850:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b00c613/0x66475b4e8b851f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x174c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.604867:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.605059:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+36:3314:x1869066299137408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4611us (6144us total) trans 8589940399 rc 0/0 00000100:00100000:0.0:1782487582.605073:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15341 00010000:00010000:0.0:1782487582.605101:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605109:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605119:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605129:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb90677/0x66475b4e8b851f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605157:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.605407:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3314:x1869066299136896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5334us (6543us total) trans 8589939705 rc 0/0 00000100:00100000:0.0:1782487582.605416:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15340 00000100:00100000:0.0:1782487582.605439:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299140992 00000100:00100000:0.0:1782487582.605445:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299140992 00000100:00100000:0.0:1782487582.605487:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15354 00000100:00100000:0.0:1782487582.605500:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3316:x1869066299140864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.605517:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5974 count 1 00010000:00010000:0.0:1782487582.605531:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605544:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 180 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605554:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1756:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487582.605558:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.605564:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605597:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 180 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.605652:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 180 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.605683:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299141248:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.605731:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.607031:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293800576 00000100:00100000:0.0:1782487582.607036:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293800576 00010000:00010000:0.0:1782487582.607059:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2b74d81/0x66475b4e8b8452ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ed3 expref: 181 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607087:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293800832 00000100:00100000:0.0:1782487582.607092:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293800832 00010000:00010000:0.0:1782487582.607108:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b844dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d83 expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607128:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293801088 00000100:00100000:0.0:1782487582.607132:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293801088 00010000:00010000:0.0:1782487582.607149:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b8452e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1750:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ec5 expref: 182 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607168:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293801472 00000100:00100000:0.0:1782487582.607173:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293801472 00010000:00010000:0.0:1782487582.607192:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b844de2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d7c expref: 153 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607217:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293801600 00000100:00100000:0.0:1782487582.607220:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293801600 00010000:00010000:0.0:1782487582.607251:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8097896/0x66475b4e8b844f39 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470dbb expref: 139 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607277:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293800704 00000100:00100000:0.0:1782487582.607282:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293800704 00010000:00010000:0.0:1782487582.607296:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b844989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c41 expref: 153 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607322:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293800960 00000100:00100000:0.0:1782487582.607327:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293800960 00010000:00010000:0.0:1782487582.607343:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2bc366e/0x66475b4e8b8456cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1750:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471007 expref: 140 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607361:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293801344 00000100:00100000:0.0:1782487582.607366:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293801344 00010000:00010000:0.0:1782487582.607386:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033227a13/0x66475b4e8b8447c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bbc expref: 154 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.607414:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5791 00000100:00100000:0.0:1782487582.607427:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+154:2363:x1869066293800832:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.607439:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.607447:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b844dcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d83 expref: 154 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607481:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b844dcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d83 expref: 154 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607506:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b844dcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1725:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d83 expref: 154 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607525:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.607530:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.607539:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b851fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607559:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b851fb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1725:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607582:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.607653:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+153:2363:x1869066293800832:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 227us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.607665:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5791 00000100:00100000:0.0:1782487582.607689:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5793 00000100:00100000:0.0:1782487582.607702:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+152:2363:x1869066293801472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.607715:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.607724:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b844de2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d7c expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607752:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b844de2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d7c expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607777:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b844de2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1724:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d7c expref: 152 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607792:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.607798:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.607806:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000599533c4/0x66475b4e8b851fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607820:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000599533c4/0x66475b4e8b851fcd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1724:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607843:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.607872:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+151:2363:x1869066293801472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.607891:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5793 00000100:00100000:0.0:1782487582.607915:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5795 00000100:00100000:0.0:1782487582.607926:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2363:x1869066293800704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.607940:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.607949:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b844989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c41 expref: 150 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.607970:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b844989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c41 expref: 150 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608181:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b844989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1721:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470c41 expref: 150 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608194:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.608198:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.608203:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000335bee1/0x66475b4e8b851fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608215:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000335bee1/0x66475b4e8b851fa3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1721:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608254:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.608281:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+149:2363:x1869066293800704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 354us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.608291:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5795 00000100:00100000:0.0:1782487582.608310:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5798 00000100:00100000:0.0:1782487582.608322:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+148:2363:x1869066293801344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.608335:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.608343:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033227a13/0x66475b4e8b8447c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bbc expref: 148 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608367:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033227a13/0x66475b4e8b8447c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bbc expref: 148 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608398:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033227a13/0x66475b4e8b8447c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1720:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470bbc expref: 148 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608424:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.608430:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.608435:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b851fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608458:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b851fc6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1720:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.608477:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.608501:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2363:x1869066293801344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.608520:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5798 00000100:00100000:0.0:1782487582.609698:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802496 00000100:00100000:0.0:1782487582.609704:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802496 00000100:00100000:0.0:1782487582.609742:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5465 00000100:00100000:0.0:1782487582.609753:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:293393:x1869066293802496:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:0.0:1782487582.609962:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:293393:x1869066293802496:12345-192.168.202.21@tcp:35:touch.500 Request processed in 209us (298us total) trans 8589955704 rc 0/0 00000100:00100000:0.0:1782487582.609981:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5465 00000100:00100000:0.0:1782487582.610184:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802112 00000100:00100000:0.0:1782487582.610189:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802112 00010000:00010000:0.0:1782487582.610214:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000039e363c/0x66475b4e8b8456e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47100e expref: 137 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.610252:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802624 00000100:00100000:0.0:1782487582.610256:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802624 00010000:00010000:0.0:1782487582.610278:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b844ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d8a expref: 147 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.610306:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802240 00000100:00100000:0.0:1782487582.610313:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802240 00010000:00010000:0.0:1782487582.610330:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b8452f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ecc expref: 179 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.610351:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802752 00000100:00100000:0.0:1782487582.610356:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802752 00010000:00010000:0.0:1782487582.610376:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b8452f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1729:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ee1 expref: 153 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.610395:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5799 00000100:00100000:0.0:1782487582.610405:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2362:x1869066293802112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.610415:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.610421:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000039e363c/0x66475b4e8b8456e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47100e expref: 137 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610443:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000039e363c/0x66475b4e8b8456e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47100e expref: 137 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610459:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.610487:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2362:x1869066293802112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.610497:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5799 00000100:00100000:0.0:1782487582.610546:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5800 00000100:00100000:0.0:1782487582.610558:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2362:x1869066293802624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.610569:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.610575:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b844ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d8a expref: 147 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610588:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b844ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d8a expref: 147 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610632:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b844ddb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1726:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470d8a expref: 147 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610650:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.610656:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.610663:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000339ae679/0x66475b4e8b851fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610680:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000339ae679/0x66475b4e8b851fe2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1726:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610719:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.610863:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2362:x1869066293802624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 308us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.610873:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5800 00000100:00100000:0.0:1782487582.610896:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5801 00000100:00100000:0.0:1782487582.610914:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:2362:x1869066293802240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.610929:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.610938:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b8452f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ecc expref: 179 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610967:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b8452f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ecc expref: 179 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.610990:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.610998:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x174e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.611009:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b851fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611023:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b851fdb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x174e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611061:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.611091:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:2362:x1869066293802240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 181us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.611113:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5801 00000100:00100000:0.0:1782487582.611134:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293803008 00000100:00100000:0.0:1782487582.611141:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293803008 00010000:00010000:0.0:1782487582.611158:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 179 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611184:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5802 00000100:00100000:0.0:1782487582.611195:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+153:2362:x1869066293802752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.611204:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.611211:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b8452f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ee1 expref: 153 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611228:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b8452f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470ee1 expref: 153 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611266:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.611276:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.611283:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b851fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611303:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b851fe9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1729:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611337:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.611367:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+153:2362:x1869066293802752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 173us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.611377:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5802 00000100:00100000:0.0:1782487582.611395:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293803264 00000100:00100000:0.0:1782487582.611402:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293803264 00010000:00010000:0.0:1782487582.611423:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b8452b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1727:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eb0 expref: 153 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611455:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293802880 00000100:00100000:0.0:1782487582.611460:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293802880 00010000:00010000:0.0:1782487582.611480:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b845b10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47116c expref: 180 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611507:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293803136 00000100:00100000:0.0:1782487582.611513:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293803136 00010000:00010000:0.0:1782487582.611534:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b845db7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4711f1 expref: 137 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611554:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293803648 00000100:00100000:0.0:1782487582.611559:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293803648 00010000:00010000:0.0:1782487582.611578:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b8452dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1728:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eb7 expref: 154 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611643:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293803776 00000100:00100000:0.0:1782487582.611649:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293803776 00010000:00010000:0.0:1782487582.611669:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b8452ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eda expref: 155 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.611703:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5803 00000100:00100000:0.0:1782487582.611719:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+180:2363:x1869066293803008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.611734:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.611745:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 180 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611774:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 180 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611805:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.611814:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.611824:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611849:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611875:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.611899:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+180:2363:x1869066293803008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 184us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.611919:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5803 00000100:00100000:0.0:1782487582.611939:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5804 00000100:00100000:0.0:1782487582.611950:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2363:x1869066293803264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.611959:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.611970:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b8452b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eb0 expref: 155 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.611998:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b8452b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eb0 expref: 155 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612027:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612035:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612046:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e3c957/0x66475b4e8b85200c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612056:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e3c957/0x66475b4e8b85200c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1727:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612077:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.612104:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2363:x1869066293803264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 155us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.612113:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5804 00000100:00100000:0.0:1782487582.612134:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5805 00000100:00100000:0.0:1782487582.612147:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:2363:x1869066293802880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.612157:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.612165:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b845b10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47116c expref: 179 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612200:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b845b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47116c expref: 179 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612229:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612249:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612259:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b851ffe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612275:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b851ffe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612299:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.612329:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:2363:x1869066293802880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 185us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.612346:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5805 00000100:00100000:0.0:1782487582.612368:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5806 00000100:00100000:0.0:1782487582.612383:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2363:x1869066293803136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.612398:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.612408:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b845db7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4711f1 expref: 137 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612423:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b845db7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4711f1 expref: 137 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612467:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612472:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.612478:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090c6086b/0x66475b4e8b852005 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612487:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c6086b/0x66475b4e8b852005 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612503:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.612540:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2363:x1869066293803136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.612560:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5806 00000100:00100000:0.0:1782487582.612603:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5808 00010000:00010000:0.0:1782487582.612676:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ef0154/0x66475b4e8b845ad8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47115e expref: 178 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.612692:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299141248:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.612709:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612726:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612734:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612744:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612754:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b851ff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612791:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.612939:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3316:x1869066299140864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7439us (7662us total) trans 8589940405 rc 0/0 00000100:00100000:0.0:1782487582.612954:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15354 00010000:00010000:0.0:1782487582.612982:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.612996:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613009:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613016:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ede00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.613023:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613044:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613058:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa68:0x0].0x0 (ffff9cb45a514000) 00010000:00010000:0.0:1782487582.613066:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.613073:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613093:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b852021 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa68:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.613124:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2362:x1869066293803776:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.613141:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.613150:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b8452ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eda expref: 151 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613165:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b8452ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x172a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470eda expref: 151 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613213:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.613221:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.613229:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cb383ad/0x66475b4e8b85201a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x172a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613250:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb383ad/0x66475b4e8b85201a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x172a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.613266:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.613287:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2362:x1869066293803776:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 651us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.613299:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5808 00000100:00100000:0.0:1782487582.614669:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293804288 00000100:00100000:0.0:1782487582.614675:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293804288 00010000:00010000:0.0:1782487582.614700:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000087013f8/0x66475b4e8b845583 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470f90 expref: 151 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.614730:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5809 00000100:00100000:0.0:1782487582.614742:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2362:x1869066293804288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.614753:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.614761:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000087013f8/0x66475b4e8b845583 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470f90 expref: 151 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.614788:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000087013f8/0x66475b4e8b845583 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x172d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a470f90 expref: 151 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.614821:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.614825:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.614831:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d243e4/0x66475b4e8b85203d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x172d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.614850:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d243e4/0x66475b4e8b85203d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x172d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.614885:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.615057:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2362:x1869066293804288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 318us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.615067:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5809 00000100:00100000:0.0:1782487582.615089:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293804672 00000100:00100000:0.0:1782487582.615095:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293804672 00010000:00010000:0.0:1782487582.615116:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085888200/0x66475b4e8b845b33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1754:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471173 expref: 176 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.615149:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5810 00000100:00100000:0.0:1782487582.615163:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+176:2362:x1869066293804672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.615174:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.615182:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085888200/0x66475b4e8b845b33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471173 expref: 176 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615197:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085888200/0x66475b4e8b845b33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471173 expref: 176 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615216:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.615220:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.615225:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006072c3d2/0x66475b4e8b85204b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615252:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006072c3d2/0x66475b4e8b85204b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1754:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615270:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.615309:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+177:2362:x1869066293804672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 146us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.615322:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5810 00000100:00100000:0.0:1782487582.615347:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5811 00000100:00100000:0.0:1782487582.615361:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+177:2362:x1869066293804928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.615372:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.615381:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c87dbd1/0x66475b4e8b845bc6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471196 expref: 177 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615404:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c87dbd1/0x66475b4e8b845bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471196 expref: 177 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615422:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.615429:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.615440:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b852052 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615466:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b852052 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1755:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615502:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.615528:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+176:2362:x1869066293804928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.615549:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5811 00010000:00010000:0.0:1782487582.615578:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615593:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615602:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615634:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.615639:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615647:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615660:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb45a514d00) 00010000:00010000:0.0:1782487582.615666:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.615672:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.615685:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85202f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619537:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293805184 00000100:00100000:0.0:1782487582.619544:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293805184 00010000:00010000:0.0:1782487582.619578:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b845735 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47102a expref: 149 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619661:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293805440 00000100:00100000:0.0:1782487582.619667:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293805440 00010000:00010000:0.0:1782487582.619689:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078b87481/0x66475b4e8b845942 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47108c expref: 147 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619720:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293805696 00000100:00100000:0.0:1782487582.619725:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293805696 00010000:00010000:0.0:1782487582.619742:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8460ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x175a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4712fb expref: 135 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619782:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293805312 00000100:00100000:0.0:1782487582.619787:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293805312 00010000:00010000:0.0:1782487582.619803:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000872b2c5f/0x66475b4e8b845a7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1731:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47112d expref: 150 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619823:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293805568 00000100:00100000:0.0:1782487582.619827:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293805568 00010000:00010000:0.0:1782487582.619844:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b845dcc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471206 expref: 136 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.619875:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5813 00000100:00100000:0.0:1782487582.619887:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+150:2362:x1869066293805184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.619902:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.619911:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b845735 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x172e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47102a expref: 150 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.619928:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b845735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x172e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47102a expref: 150 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.619960:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.619969:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x172e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.619980:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620016:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620051:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.620085:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+150:2362:x1869066293805184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 199us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.620101:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5813 00000100:00100000:0.0:1782487582.620163:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5815 00000100:00100000:0.0:1782487582.620181:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2362:x1869066293805696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.620194:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.620204:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8460ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4712fb expref: 136 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620248:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8460ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x175a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4712fb expref: 136 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620273:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8460ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x175a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4712fb expref: 136 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620304:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.620314:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.620327:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620375:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620414:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.620444:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2362:x1869066293805696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 267us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.620457:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5815 00010000:00010000:0.0:1782487582.620506:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620522:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620544:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620565:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.620572:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620592:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620642:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb57fd34d00) 00010000:00010000:0.0:1782487582.620651:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.620659:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620681:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b85208a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620722:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620743:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620769:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620793:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.620825:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.621009:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3317:x1869066299143808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6080us (6472us total) trans 8589940411 rc 0/0 00000100:00100000:0.0:1782487582.621021:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15369 00010000:00010000:0.0:1782487582.621047:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.621054:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621076:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.621081:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621104:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621118:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621128:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85207c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621147:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.621150:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.621154:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.621430:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299147136 00000100:00100000:0.0:1782487582.621435:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299147136 00000100:00100000:0.0:1782487582.621461:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15381 00000100:00100000:0.0:1782487582.621469:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3317:x1869066299147136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.621481:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5939 count 1 00010000:00010000:0.0:1782487582.621492:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621513:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b845e0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471214 expref: 146 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621538:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1733:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487582.621547:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.621558:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621597:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b845e0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471214 expref: 146 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.621648:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b845e0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471214 expref: 146 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.621663:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299147392:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.621706:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.623195:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293807616 00000100:00100000:0.0:1782487582.623200:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293807616 00000100:00100000:0.0:1782487582.623229:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1006 00000100:00100000:0.0:1782487582.623256:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2360:x1869066293807616:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.623282:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.623295:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b852186 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474c28 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623345:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623367:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623388:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623405:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623414:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623432:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623520:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623534:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623546:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.623568:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa7:0x0]: returning size 0 00000004:00200000:0.0:1782487582.623572:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.623584:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623601:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623637:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623655:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623673:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623692:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.623699:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623713:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623735:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.623740:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.623746:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623768:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54a00/0x66475b4e8b85218d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623795:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623812:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623835:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623858:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.623863:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623871:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623880:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb46f434200) 00010000:00010000:0.0:1782487582.623882:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.623885:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.623891:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b852194 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625255:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b852186 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c28 expref: 125 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625273:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85219b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c28 expref: 124 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625287:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa7:0x0].0x0 (ffff9cb548f15900) 00010000:00010000:0.0:1782487582.625292:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.625295:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0ce00, rc 0) 00000100:00100000:0.0:1782487582.625323:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2360:x1869066293807616:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2071us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.625336:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1006 00010000:00010000:0.0:1782487582.625358:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.625364:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625386:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.625394:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625424:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625465:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625487:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca79d51/0x66475b4e8b85206e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x172e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.625509:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.625513:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.625516:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.626924:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293806208 00000100:00100000:0.0:1782487582.626931:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293806208 00010000:00010000:0.0:1782487582.626959:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c24c991/0x66475b4e8b846336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4713a3 expref: 133 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.626995:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293806592 00000100:00100000:0.0:1782487582.627000:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293806592 00010000:00010000:0.0:1782487582.627020:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b84610d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471310 expref: 134 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.627060:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293807232 00000100:00100000:0.0:1782487582.627067:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293807232 00010000:00010000:0.0:1782487582.627087:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b845aae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x172c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47113b expref: 146 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.629690:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293806464 00000100:00100000:0.0:1782487582.629697:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293806464 00010000:00010000:0.0:1782487582.629724:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d5b061c/0x66475b4e8b845ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x172f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471150 expref: 148 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.629747:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293807360 00000100:00100000:0.0:1782487582.629752:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293807360 00010000:00010000:0.0:1782487582.629774:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db394d07/0x66475b4e8b84633d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4713aa expref: 135 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.629808:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5819 00000100:00100000:0.0:1782487582.629823:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2363:x1869066293806592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.629840:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.629852:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b84610d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471310 expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.629885:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b84610d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x175b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471310 expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.629911:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b84610d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x175b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471310 expref: 134 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.629931:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.629942:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.629954:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b8520a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.629982:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b8520a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.630013:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293810176 00000100:00100000:0.0:1782487582.630018:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293810176 00000100:00100000:0.0:1782487582.630055:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1009 00000100:00100000:0.0:1782487582.630070:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+505:2360:x1869066293810176:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.630098:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.630113:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85230e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474c83 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630151:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630175:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630187:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630209:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630223:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630245:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630326:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630344:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630352:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.630369:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaa3:0x0]: returning size 0 00000004:00200000:0.0:1782487582.630373:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487582.630385:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630396:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630414:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630425:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630433:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630454:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.630459:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630469:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630480:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.630486:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.630491:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630498:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b852315 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630521:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630538:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630554:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630574:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.630582:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630596:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630649:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb46f434800) 00010000:00010000:0.0:1782487582.630656:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.630661:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630683:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85231c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630762:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec800/0x66475b4e8b85230e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c83 expref: 508 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630795:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b852323 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c83 expref: 507 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630807:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434f00) 00010000:00010000:0.0:1782487582.630815:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.630821:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6200, rc 0) 00000100:00100000:0.0:1782487582.630866:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb449acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+508:2360:x1869066293810176:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 798us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.630882:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1009 00000100:00100000:0.0:1782487582.630918:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5822 00000100:00100000:0.0:1782487582.630934:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2363:x1869066293806848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.630951:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.630961:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b845b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471165 expref: 146 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.630985:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b845b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471165 expref: 146 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631022:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b845b1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1730:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471165 expref: 146 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631057:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631067:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631078:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631108:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631149:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.631179:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2363:x1869066293806848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 247us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.631200:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5822 00000100:00100000:0.0:1782487582.631228:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5825 00000100:00100000:0.0:1782487582.631260:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+177:2363:x1869066293809408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.631278:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.631289:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b762232/0x66475b4e8b8466c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4714c2 expref: 177 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631320:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b762232/0x66475b4e8b8466c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4714c2 expref: 177 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631356:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631366:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631374:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631400:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631454:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.631482:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+177:2363:x1869066293809408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 225us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.631503:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5825 00000100:00100000:0.0:1782487582.631531:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5827 00000100:00100000:0.0:1782487582.631547:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+176:2363:x1869066293809920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.631565:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.631573:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace5651b/0x66475b4e8b846607 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1760:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47148a expref: 176 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631687:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace5651b/0x66475b4e8b846607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1760:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47148a expref: 176 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631710:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.631737:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+176:2363:x1869066293809920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.631760:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5827 00000100:00100000:0.0:1782487582.631789:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5829 00000100:00100000:0.0:1782487582.631805:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2363:x1869066293809536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.631824:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.631833:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b845dc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4711ff expref: 146 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631883:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b845dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4711ff expref: 146 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631914:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631922:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.631933:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000765003ff/0x66475b4e8b852132 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631954:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765003ff/0x66475b4e8b852132 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1732:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.631976:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.631997:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2363:x1869066293809536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.632010:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5829 00000100:00100000:0.0:1782487582.632031:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5831 00000100:00100000:0.0:1782487582.632045:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2363:x1869066293810304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.632061:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.632072:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b846941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471578 expref: 131 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632093:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b846941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471578 expref: 131 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632138:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b846941 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471578 expref: 131 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632164:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.632188:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+130:2363:x1869066293810304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 145us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.632205:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5831 00000100:00100000:0.0:1782487582.632249:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5833 00000100:00100000:0.0:1782487582.632265:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+173:2362:x1869066293810560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.632278:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.632288:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b84657b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471452 expref: 173 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632323:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b84657b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471452 expref: 173 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632360:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b84657b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x175f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471452 expref: 173 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632391:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.632401:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x175f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.632413:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632447:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632483:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.632509:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+172:2362:x1869066293810560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 245us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.632525:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5833 00010000:00010000:0.0:1782487582.632586:0:213220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b845e0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1733:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471214 expref: 149 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.632601:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299147392:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.632650:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632662:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632675:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632693:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632719:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b852163 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.632753:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.632934:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb449acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3317:x1869066299147136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11461us (11525us total) trans 8589939723 rc 0/0 00000100:00100000:0.0:1782487582.632953:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15381 00010000:00010000:0.0:1782487582.633004:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.633026:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2363:x1869066293806592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 3206us (6043us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.633049:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5819 00010000:00010000:0.0:1782487582.633124:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633138:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633151:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633178:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633211:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.633447:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3314:x1869066299147776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10466us (10747us total) trans 8589940414 rc 0/0 00000100:00100000:0.0:1782487582.633456:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15383 00010000:00010000:0.0:1782487582.633479:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.633491:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633505:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.633510:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633527:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633549:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633571:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c72d81/0x66475b4e8b852178 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x175f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633594:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.633600:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b8520c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633633:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88fe00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.633639:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b8520c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633648:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b8520c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633680:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b8520c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633692:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b8520c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633708:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.633711:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.633714:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.633735:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633745:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633753:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633762:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004620a504/0x66475b4e8b8520ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.633780:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.634033:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+55:3315:x1869066299144448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17054us (18695us total) trans 8589939724 rc 0/0 00000100:00100000:0.0:1782487582.634043:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15374 00000100:00100000:0.0:1782487582.634067:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299148928 00000100:00100000:0.0:1782487582.634072:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299148928 00000100:00100000:0.0:1782487582.634099:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299149056 00000100:00100000:0.0:1782487582.634104:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299149056 00000100:00100000:0.0:1782487582.634134:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15391 00000100:00100000:0.0:1782487582.634146:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+55:3314:x1869066299148928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.634167:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5941 count 1 00010000:00010000:0.0:1782487582.634188:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634217:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634251:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1735:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.634258:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.634265:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634300:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634320:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.634334:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299149568:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.634390:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b780 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.634410:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299149312 00000100:00100000:0.0:1782487582.634416:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299149312 00000100:00100000:0.0:1782487582.634441:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299149184 00000100:00100000:0.0:1782487582.634447:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299149184 00000100:00100000:0.0:1782487582.634473:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15392 00000100:00100000:0.0:1782487582.634488:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3314:x1869066299149056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.634508:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5988 count 1 00010000:00010000:0.0:1782487582.634527:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634553:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b846cdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4716a5 expref: 170 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634572:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1764:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.634583:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.634595:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634653:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b846cdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716a5 expref: 170 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634681:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b846cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716a5 expref: 170 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.634709:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299149824:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.634751:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45462b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.634775:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15394 00000100:00100000:0.0:1782487582.634792:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3317:x1869066299149184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.634812:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5987 count 1 00010000:00010000:0.0:1782487582.634829:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634860:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 170 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634888:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1763:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.634897:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.634909:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634952:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 170 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.634975:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 170 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.634995:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299150080:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.635029:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00480 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.635043:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.635555:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.635564:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b852098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635584:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d87200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.635593:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b852098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635637:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b852098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635657:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b852098 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635667:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b852098 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635701:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.635709:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635727:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.635735:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635749:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635783:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635812:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3284bdf/0x66475b4e8b85210f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.635843:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.635847:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.635852:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.636579:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293811200 00000100:00100000:0.0:1782487582.636586:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293811200 00010000:00010000:0.0:1782487582.636633:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b846328 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1736:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471395 expref: 149 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.636674:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293811584 00000100:00100000:0.0:1782487582.636680:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293811584 00000100:00100000:0.0:1782487582.636709:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293811328 00000100:00100000:0.0:1782487582.636715:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293811328 00010000:00010000:0.0:1782487582.636736:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b8460f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1734:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471302 expref: 150 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.636782:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1081 00000100:00100000:0.0:1782487582.636799:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+130:2362:x1869066293811584:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.636813:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.636834:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85224a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c36 expref: 130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.636866:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434f00) 00010000:00010000:0.0:1782487582.636872:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.636908:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2362:x1869066293811584:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.636926:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1081 00000100:00100000:0.0:1782487582.636951:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5834 00000100:00100000:0.0:1782487582.636965:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2362:x1869066293811200:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.636976:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.636983:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b846328 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471395 expref: 150 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637017:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b846328 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471395 expref: 150 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637046:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.637056:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.637067:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8521d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637095:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8521d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1736:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637127:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.637158:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+150:2362:x1869066293811200:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.637172:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5834 00000100:00100000:0.0:1782487582.637223:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5835 00000100:00100000:0.0:1782487582.637253:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+149:2362:x1869066293811328:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.637264:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.637273:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b8460f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471302 expref: 149 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637295:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b8460f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471302 expref: 149 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637324:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.637333:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.637344:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8521b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637359:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8521b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1734:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.637393:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.637423:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+149:2362:x1869066293811328:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 186us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.637440:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5835 00010000:00010000:0.0:1782487582.637475:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.638371:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299149568:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.638395:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638447:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299149824:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.638470:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638536:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299150080:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.638557:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638779:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293812480 00000100:00100000:0.0:1782487582.638785:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293812480 00010000:00010000:0.0:1782487582.638809:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638852:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293812608 00000100:00100000:0.0:1782487582.638858:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293812608 00010000:00010000:0.0:1782487582.638878:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b846cdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716a5 expref: 174 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638915:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293812736 00000100:00100000:0.0:1782487582.638920:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293812736 00000100:00100000:0.0:1782487582.638945:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293812864 00000100:00100000:0.0:1782487582.638950:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293812864 00010000:00010000:0.0:1782487582.638967:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 175 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.638995:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293812992 00000100:00100000:0.0:1782487582.638999:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293812992 00010000:00010000:0.0:1782487582.639014:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b846ceb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c8 expref: 176 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.639043:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5836 00000100:00100000:0.0:1782487582.639054:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+148:2362:x1869066293812480:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.639066:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.639077:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639096:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639124:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cef7938/0x66475b4e8b84632f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1735:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47139c expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639150:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.639156:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.639167:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639186:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639214:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.639250:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2362:x1869066293812480:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 196us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.639262:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5836 00000100:00100000:0.0:1782487582.639286:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5838 00000100:00100000:0.0:1782487582.639299:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+175:2363:x1869066293812864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.639312:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.639317:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 174 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639334:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 174 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639348:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b846cc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716b3 expref: 174 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639373:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.639379:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.639389:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639406:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639433:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.639457:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+172:2363:x1869066293812864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 160us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.639464:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5838 00000100:00100000:0.0:1782487582.639486:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1082 00000100:00100000:0.0:1782487582.639498:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+509:2363:x1869066293812736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.639508:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.639524:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b852346 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c60 expref: 509 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639550:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa67:0x0].0x0 (ffff9cb57fd34000) 00010000:00010000:0.0:1782487582.639555:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.639584:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+508:2363:x1869066293812736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 87us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.639623:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1082 00010000:00010000:0.0:1782487582.639688:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639704:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639730:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639756:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.639790:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.639980:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3317:x1869066299149184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5192us (5672us total) trans 8589940421 rc 0/0 00000100:00100000:0.0:1782487582.639990:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15394 00000100:00100000:0.0:1782487582.640005:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293813248 00000100:00100000:0.0:1782487582.640009:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293813248 00000100:00100000:0.0:1782487582.640025:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15408 00000100:00100000:0.0:1782487582.640031:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3316:x1869066299151232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.640043:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5991 count 1 00010000:00010000:0.0:1782487582.640054:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640067:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640073:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1767:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.640076:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.640080:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640098:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640108:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.640118:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299152128:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.640261:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb560be2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.640281:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.640288:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640301:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.640305:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640329:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640341:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640361:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b852403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640390:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.640394:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.640398:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.640418:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5843 00000100:00100000:0.0:1782487582.640432:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2362:x1869066293813632:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.640445:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.640453:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db46a03e/0x66475b4e8b846344 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4713b1 expref: 146 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640481:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db46a03e/0x66475b4e8b846344 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4713b1 expref: 146 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640515:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.640525:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.640533:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b85242d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640545:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b85242d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1737:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640564:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.640594:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2362:x1869066293813632:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.640636:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5843 00010000:00010000:0.0:1782487582.640675:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640690:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640708:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640736:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b8523cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.640765:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.640997:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+61:3314:x1869066299148928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6854us (7143us total) trans 8589939728 rc 0/0 00000100:00100000:0.0:1782487582.641010:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15391 00000100:00100000:0.0:1782487582.641035:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15411 00000100:00100000:0.0:1782487582.641049:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+171:2360:x1869066293813248:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.641061:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.641076:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474d08 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.641094:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17ef:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.641107:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=7210s v=(0 0) 00010000:00010000:0.0:1782487582.641112:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.641125:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 172 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641154:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 172 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641173:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d800, rc 0) 00000100:00100000:0.0:1782487582.641202:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+172:2360:x1869066293813248:12345-192.168.202.21@tcp:101:rm.500 Request processed in 154us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.641216:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15411 00010000:00010000:0.0:1782487582.641260:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641286:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641308:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641318:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099215138/0x66475b4e8b8523ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641339:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:0.0:1782487582.641509:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3314:x1869066299149056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7025us (7450us total) trans 8589940423 rc 0/0 00000100:00100000:0.0:1782487582.641518:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15392 00010000:00010000:0.0:1782487582.641539:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.641545:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6018a97/0x66475b4e8b852101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641553:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579764400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.641557:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6018a97/0x66475b4e8b852101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x175e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641566:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6018a97/0x66475b4e8b852101 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x175e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641580:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6018a97/0x66475b4e8b852101 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x175e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641589:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6018a97/0x66475b4e8b852101 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x175e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641662:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.641666:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8523f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641675:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025a600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.641679:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8523f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641687:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8523f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641698:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8523f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641706:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f80a9f63/0x66475b4e8b8523f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641722:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.641725:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.641730:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.641740:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.641757:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293813888 00000100:00100000:0.0:1782487582.641762:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293813888 00000100:00100000:0.0:1782487582.641803:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1084 00000100:00100000:0.0:1782487582.641818:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+507:2363:x1869066293813888:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.641836:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.641855:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d35400/0x66475b4e8b8523d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa66:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cc9 expref: 507 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.641880:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa66:0x0].0x0 (ffff9cb45a514c00) 00010000:00010000:0.0:1782487582.641886:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.641919:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+506:2363:x1869066293813888:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 105us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.641933:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1084 00000100:00100000:0.0:1782487582.642041:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299152640 00000100:00100000:0.0:1782487582.642046:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299152640 00000100:00100000:0.0:1782487582.642079:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15412 00000100:00100000:0.0:1782487582.642093:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+62:3315:x1869066299152640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.642113:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5947 count 1 00010000:00010000:0.0:1782487582.642126:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642144:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b84695d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471594 expref: 143 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642165:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b846cac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471689 expref: 142 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642182:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.642187:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.642191:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642213:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b846cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471689 expref: 142 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642248:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b846cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471689 expref: 142 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.642272:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299153280:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.642317:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b84695d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471594 expref: 143 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642330:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b84695d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471594 expref: 143 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.642354:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299153536:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.642378:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb560be2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.642399:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299153152 00000100:00100000:0.0:1782487582.642405:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299153152 00000100:00100000:0.0:1782487582.642443:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15414 00000100:00100000:0.0:1782487582.642457:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3314:x1869066299153152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.642476:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5953 count 1 00010000:00010000:0.0:1782487582.642491:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642513:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642531:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 142 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642542:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1741:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.642548:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.642552:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642576:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 142 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642592:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 142 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.642638:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299154048:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.642704:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642724:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.642742:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299154176:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.642777:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb560be2900 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.642797:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299153792 00000100:00100000:0.0:1782487582.642803:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299153792 00000100:00100000:0.0:1782487582.642828:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15417 00000100:00100000:0.0:1782487582.642839:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3316:x1869066299152896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.642853:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5996 count 1 00010000:00010000:0.0:1782487582.642869:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642896:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cc0e984/0x66475b4e8b8478de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471a2c expref: 126 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642905:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.642909:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.642915:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642953:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cc0e984/0x66475b4e8b8478de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a2c expref: 126 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.642972:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cc0e984/0x66475b4e8b8478de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a2c expref: 126 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.642984:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299154688:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.643015:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb560be2000 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.643902:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299152128:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.643928:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.644026:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293814016 00000100:00100000:0.0:1782487582.644033:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293814016 00000100:00100000:0.0:1782487582.644070:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293814912 00000100:00100000:0.0:1782487582.644075:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293814912 00010000:00010000:0.0:1782487582.644097:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b846814 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471516 expref: 144 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.644131:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293814272 00000100:00100000:0.0:1782487582.644136:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293814272 00010000:00010000:0.0:1782487582.644154:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066b6f8c9/0x66475b4e8b847247 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471865 expref: 171 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.644188:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5845 00000100:00100000:0.0:1782487582.644206:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+171:2363:x1869066293814272:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.644221:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.644242:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066b6f8c9/0x66475b4e8b847247 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471865 expref: 171 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644263:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066b6f8c9/0x66475b4e8b847247 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471865 expref: 171 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644284:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b6f8c9/0x66475b4e8b847247 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471865 expref: 171 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644304:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.644309:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.644315:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644326:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644351:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.644391:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+170:2363:x1869066293814272:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 189us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.644406:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5845 00010000:00010000:0.0:1782487582.644450:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644472:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644497:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644523:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033227a13/0x66475b4e8b8524a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.644554:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.644876:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+63:3314:x1869066299150848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6173us (6615us total) trans 8589940426 rc 0/0 00000100:00100000:0.0:1782487582.644888:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15405 00000100:00100000:0.0:1782487582.644913:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293814144 00000100:00100000:0.0:1782487582.644917:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293814144 00000100:00100000:0.0:1782487582.644950:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15422 00000100:00100000:0.0:1782487582.644965:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+143:2363:x1869066293814144:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.644978:0:213211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.644993:0:213211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474d0f expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.645012:0:213211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17c7:0x0] initial LVB size: 0, mtime: 0x6a3e9a1e, atime: 0x6a3e9a1e, ctime: 0x6a3e9a1e, blocks: 0x1 00010000:00010000:0.0:1782487582.645029:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=7210s v=(0 0) 00010000:00010000:0.0:1782487582.645038:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.645050:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 144 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645075:0:213211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 144 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645101:0:213211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8c200, rc 0) 00000100:00100000:0.0:1782487582.645135:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2363:x1869066293814144:12345-192.168.202.21@tcp:101:rm.500 Request processed in 174us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.645149:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15422 00010000:00010000:0.0:1782487582.645170:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.645182:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293815040 00000100:00100000:0.0:1782487582.645187:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293815040 00010000:00010000:0.0:1782487582.645204:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b846948 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1739:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47157f expref: 144 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.645240:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293815296 00000100:00100000:0.0:1782487582.645246:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293815296 00010000:00010000:0.0:1782487582.645263:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.645306:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5847 00000100:00100000:0.0:1782487582.645320:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2363:x1869066293815168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.645335:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.645344:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b846589 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1739:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471459 expref: 144 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645378:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b846589 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1739:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471459 expref: 144 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645679:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.645707:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2363:x1869066293815168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 391us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.645723:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5847 00000100:00100000:0.0:1782487582.645749:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5848 00000100:00100000:0.0:1782487582.645759:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+171:2363:x1869066293815296:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.645770:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.645779:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645832:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645851:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3878352/0x66475b4e8b847255 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471873 expref: 171 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645877:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.645881:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.645886:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645895:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645911:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.645927:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+170:2363:x1869066293815296:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.645933:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5848 00010000:00010000:0.0:1782487582.645954:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645963:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645970:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645979:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6629a6e/0x66475b4e8b8524b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.645994:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.646154:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3316:x1869066299151232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6122us (7673us total) trans 8589940427 rc 0/0 00000100:00100000:0.0:1782487582.646163:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15408 00000100:00100000:0.0:1782487582.646179:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299155584 00000100:00100000:0.0:1782487582.646182:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299155584 00000100:00100000:0.0:1782487582.646203:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15424 00000100:00100000:0.0:1782487582.646210:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3317:x1869066299155584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.646221:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5949 count 1 00010000:00010000:0.0:1782487582.646247:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646275:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 144 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646285:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.646293:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.646299:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646330:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 144 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646346:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 144 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.646357:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299155712:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.646403:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb560be2300 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.646441:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299154048:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.646466:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299154176:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.646491:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.646521:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5850 00000100:00100000:0.0:1782487582.646535:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5585e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2361:x1869066293815552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.646548:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.646560:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002852cf78/0x66475b4e8b84694f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471586 expref: 144 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646589:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002852cf78/0x66475b4e8b84694f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x173a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471586 expref: 144 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646640:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002852cf78/0x66475b4e8b84694f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x173a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471586 expref: 144 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646669:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.646675:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.646681:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646695:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646714:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.646744:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5585e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+143:2361:x1869066293815552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 212us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.646755:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5850 00000100:00100000:0.0:1782487582.646796:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293816832 00000100:00100000:0.0:1782487582.646802:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293816832 00010000:00010000:0.0:1782487582.646824:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b846ccf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471697 expref: 146 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.646855:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817088 00000100:00100000:0.0:1782487582.646861:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817088 00010000:00010000:0.0:1782487582.646880:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b84736d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1742:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4718b9 expref: 144 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.646903:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5851 00000100:00100000:0.0:1782487582.646911:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+170:2361:x1869066293815680:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.646919:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.646925:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5742321/0x66475b4e8b84725c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47187a expref: 170 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646944:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5742321/0x66475b4e8b84725c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47187a expref: 170 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646963:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5742321/0x66475b4e8b84725c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1768:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47187a expref: 170 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.646991:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.646998:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.647003:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000263d9ba8/0x66475b4e8b8524c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647022:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263d9ba8/0x66475b4e8b8524c7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647049:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.647075:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+169:2361:x1869066293815680:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.647092:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5851 00000100:00100000:0.0:1782487582.647117:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5854 00000100:00100000:0.0:1782487582.647131:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2361:x1869066293816192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.647146:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.647155:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 146 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647192:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 146 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647216:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba787430/0x66475b4e8b84719f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471857 expref: 146 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647249:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.647273:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2361:x1869066293816192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 144us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.647288:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5854 00000100:00100000:0.0:1782487582.647312:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5856 00000100:00100000:0.0:1782487582.647327:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2360:x1869066293816704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.647340:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.647348:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b8478d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x176a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a1e expref: 128 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647360:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b8478d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x176a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a1e expref: 128 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647385:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.647392:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.647401:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b8524ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647429:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b8524ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x176a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647462:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.647490:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2360:x1869066293816704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.647501:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5856 00000100:00100000:0.0:1782487582.647530:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5858 00000100:00100000:0.0:1782487582.647544:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+143:2361:x1869066293816576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.647559:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.647569:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647595:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647697:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b847095 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1741:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d9 expref: 143 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647715:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.647724:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.647731:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647764:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.647797:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.647833:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2361:x1869066293816576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 292us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.647842:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5858 00000100:00100000:0.0:1782487582.647860:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817344 00000100:00100000:0.0:1782487582.647864:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817344 00010000:00010000:0.0:1782487582.647885:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000511ccf03/0x66475b4e8b847e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bc2 expref: 169 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.647917:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817600 00000100:00100000:0.0:1782487582.647921:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817600 00010000:00010000:0.0:1782487582.647939:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85232a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xaab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ca6 expref: 127 pid: 213491 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.647954:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817472 00000100:00100000:0.0:1782487582.647958:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817472 00010000:00010000:0.0:1782487582.647973:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b847ba1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x176d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ac6 expref: 170 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.647989:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817728 00000100:00100000:0.0:1782487582.647994:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817728 00010000:00010000:0.0:1782487582.648014:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c8d7e80/0x66475b4e8b847f8a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x176d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c32 expref: 127 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.648061:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5861 00000100:00100000:0.0:1782487582.648079:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2362:x1869066293817216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.648097:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.648108:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b84708e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1742:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d2 expref: 141 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648139:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b84708e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d2 expref: 141 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648162:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b84708e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1742:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4717d2 expref: 141 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648180:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.648187:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.648199:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b8524ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648217:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b8524ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1742:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648260:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.648291:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2362:x1869066293817216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 214us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.648307:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5861 00000100:00100000:0.0:1782487582.648332:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5863 00000100:00100000:0.0:1782487582.648345:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2360:x1869066293817600:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.648362:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.648372:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85232a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xaab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ca6 expref: 127 pid: 213491 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648394:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85232a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ca6 expref: 127 pid: 213491 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648416:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaab:0x0].0x0 (ffff9cb45a514700) 00010000:00010000:0.0:1782487582.648423:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852529 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xaab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648434:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852529 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648445:0:190284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852529 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xaab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648475:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.648507:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2360:x1869066293817600:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.648521:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5863 00010000:00010000:0.0:1782487582.648562:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.648572:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648594:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb452643200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.648627:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648658:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648691:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648701:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085124850/0x66475b4e8b8524c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x173a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648734:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.648743:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85255a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648763:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.648769:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85255a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648788:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85255a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648807:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa67:0x0].0x0 (ffff9cb57fd34700) 00010000:00010000:0.0:1782487582.648815:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.648823:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85255a lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648835:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85255a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648867:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.648872:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.648876:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.648889:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648898:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648918:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648941:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c6e25a/0x66475b4e8b8524e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.648959:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.649181:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3314:x1869066299153152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6725us (6839us total) trans 8589939735 rc 0/0 00000100:00100000:0.0:1782487582.649197:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15414 00010000:00010000:0.0:1782487582.649260:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b846cac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471689 expref: 138 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.649277:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299153280:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.649298:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b84695d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x173b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471594 expref: 138 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.649319:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299153536:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.649342:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649357:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649375:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649393:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649416:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b8524d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x173b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649428:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.649686:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+67:3315:x1869066299152640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7595us (7668us total) trans 8589939738 rc 0/0 00000100:00100000:0.0:1782487582.649702:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15412 00000100:00100000:0.0:1782487582.649734:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817856 00000100:00100000:0.0:1782487582.649740:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817856 00010000:00010000:0.0:1782487582.649763:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 138 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.649804:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5866 00000100:00100000:0.0:1782487582.649814:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2362:x1869066293817856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.649826:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.649834:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 138 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649852:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 138 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649873:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.649878:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.649888:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649910:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.649934:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.649962:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2362:x1869066293817856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 147us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.649975:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5866 00010000:00010000:0.0:1782487582.650022:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b846ce4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x173d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716c1 expref: 137 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.650053:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299155712:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.650071:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650093:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650112:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650124:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650136:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85253e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x173d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650154:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.650340:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3317:x1869066299155584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4129us (4647us total) trans 8589939739 rc 0/0 00000100:00100000:0.0:1782487582.650360:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15424 00010000:00010000:0.0:1782487582.650400:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc0e984/0x66475b4e8b8478de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x176c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a2c expref: 125 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.650431:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299154688:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.650453:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650469:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650476:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650484:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650493:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b8524f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x176c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650512:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.650762:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:3316:x1869066299152896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7924us (8103us total) trans 8589940431 rc 0/0 00000100:00100000:0.0:1782487582.650770:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15417 00000100:00100000:0.0:1782487582.650791:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15429 00000100:00100000:0.0:1782487582.650803:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3317:x1869066299156736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.650818:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5955 count 1 00010000:00010000:0.0:1782487582.650832:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650852:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 137 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650868:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1743:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.650873:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.650877:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650916:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 137 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.650935:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 137 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.650949:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299156992:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.650986:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83b40 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.651007:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651029:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651050:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651064:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.651071:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651085:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651097:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb57fd34600) 00010000:00010000:0.0:1782487582.651101:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.651106:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651113:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85254c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.651142:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293817984 00000100:00100000:0.0:1782487582.651148:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293817984 00010000:00010000:0.0:1782487582.651173:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b846cd6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x173f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716ba expref: 137 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.651212:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5867 00000100:00100000:0.0:1782487582.651223:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2361:x1869066293817984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.651249:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.651258:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b846cd6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716ba expref: 137 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651277:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b846cd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4716ba expref: 137 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651307:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.651315:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x173f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.651324:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b852561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651345:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b852561 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x173f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.651362:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.651393:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb449acc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2361:x1869066293817984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.651405:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5867 00010000:00010000:0.0:1782487582.651432:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.651460:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847100/2, rc 0, transno 8589939735 00000100:00100000:0.0:1782487582.651474:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299153152:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.651491:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545ff800/2, rc 0, transno 8589939731 00000100:00100000:0.0:1782487582.651500:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299150976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.651519:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545fc700/2, rc 0, transno 8589940426 00000100:00100000:0.0:1782487582.651526:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299150848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.651596:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.651663:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.651691:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487582.651702:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.651747:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.651795:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb449acce00/2, rc 0, transno 8589940431 00000100:00100000:0.0:1782487582.651804:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb449acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299152896:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.651822:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847b80/2, rc 0, transno 8589939734 00000100:00100000:0.0:1782487582.651839:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299153792:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.651858:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb449ace300/2, rc 0, transno 8589940432 00000100:00100000:0.0:1782487582.651867:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb449ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299152768:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.651886:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548845880/2, rc 0, transno 8589939737 00000100:00100000:0.0:1782487582.651895:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299153664:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.651915:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545fdf80/2, rc 0, transno 8589940427 00000100:00100000:0.0:1782487582.651925:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299151232:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.651941:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545fe300/2, rc 0, transno 8589939736 00000100:00100000:0.0:1782487582.651951:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299150336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.652043:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.652077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652112:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299157632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.652146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652169:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782487582.652179:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299157760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.652212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652271:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299157632 00000100:00100000:0.0:1782487582.652278:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299157632 00000100:00100000:0.0:1782487582.652316:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15432 00000100:00100000:0.0:1782487582.652328:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+73:3314:x1869066299157888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.652347:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5959 count 1 00010000:00010000:0.0:1782487582.652364:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652396:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 136 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652428:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 137 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652454:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1747:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.652463:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.652472:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652509:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 137 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652541:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 137 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.652561:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299158400:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.652601:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 136 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.652666:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 136 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.652683:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299158528:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.652721:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.652745:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299159040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.652783:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652813:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782487582.652822:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299158656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.652865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652892:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299159168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.652933:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.652968:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299159168 00000100:00100000:0.0:1782487582.652975:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299159168 00000100:00100000:0.0:1782487582.653008:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15436 00000100:00100000:0.0:1782487582.653021:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299158912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.653040:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6004 count 1 00010000:00010000:0.0:1782487582.653058:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653085:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea2f0ea7/0x66475b4e8b848548 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471e8c expref: 166 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653094:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1774:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.653101:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.653110:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653149:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea2f0ea7/0x66475b4e8b848548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e8c expref: 166 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653161:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea2f0ea7/0x66475b4e8b848548 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e8c expref: 166 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.653175:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c0a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299159424:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.653212:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.653249:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293818624 00000100:00100000:0.0:1782487582.653255:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293818624 00010000:00010000:0.0:1782487582.653276:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058f61cc9/0x66475b4e8b8471fa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47186c expref: 137 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.653318:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293818496 00000100:00100000:0.0:1782487582.653323:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293818496 00010000:00010000:0.0:1782487582.653343:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b8484c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ddd expref: 123 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.653384:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5868 00000100:00100000:0.0:1782487582.653395:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2363:x1869066293818624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.653405:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.653413:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058f61cc9/0x66475b4e8b8471fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47186c expref: 137 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653434:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058f61cc9/0x66475b4e8b8471fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47186c expref: 137 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653470:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f61cc9/0x66475b4e8b8471fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1740:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47186c expref: 137 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653518:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.653528:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.653540:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653567:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653633:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.653666:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2363:x1869066293818624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 272us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.653678:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5868 00000100:00100000:0.0:1782487582.653701:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5869 00000100:00100000:0.0:1782487582.653718:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2362:x1869066293818496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.653733:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.653745:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b8484c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ddd expref: 123 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653768:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b8484c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ddd expref: 123 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653792:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b8484c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1775:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ddd expref: 123 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653811:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.653815:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.653820:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653828:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653858:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.653885:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2362:x1869066293818496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.653901:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5869 00010000:00010000:0.0:1782487582.653927:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.653934:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653959:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.653968:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.653983:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654006:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654024:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85256f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654043:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.654049:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654062:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.654066:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654080:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654101:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654121:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b852568 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654157:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.654161:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.654164:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.654209:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491af100/2, rc 0, transno 8589939740 00000100:00100000:0.0:1782487582.654222:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299156224:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.654252:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491af480/2, rc 0, transno 8589940434 00000100:00100000:0.0:1782487582.654263:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299156096:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.654280:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb449acdf80/2, rc 0, transno 8589940433 00000100:00100000:0.0:1782487582.654286:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb449acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299153024:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487582.654310:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654318:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654327:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654333:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.654337:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654344:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654355:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb56c096f00) 00010000:00010000:0.0:1782487582.654358:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.654362:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.654369:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852522 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.654421:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c0a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299159936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.654460:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.654493:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782487582.654505:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299160064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.654545:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.654577:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299160192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.654651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.655597:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299160832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.655668:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.655752:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299160832 00000100:00100000:0.0:1782487582.655757:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299160832 00000100:00100000:0.0:1782487582.655788:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15444 00000100:00100000:0.0:1782487582.655798:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3315:x1869066299160832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.655812:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5961 count 1 00010000:00010000:0.0:1782487582.655824:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655837:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 134 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655846:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000add52dd4/0x66475b4e8b847fa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471c4e expref: 137 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655852:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1749:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.655856:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.655860:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655883:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000add52dd4/0x66475b4e8b847fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c4e expref: 137 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655893:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000add52dd4/0x66475b4e8b847fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c4e expref: 137 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.655904:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299160960:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.655962:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 134 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.655972:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 134 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.655982:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299161088:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.656020:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.656733:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299158400:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.656769:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299156992:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.656795:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.656847:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293819008 00000100:00100000:0.0:1782487582.656854:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293819008 00010000:00010000:0.0:1782487582.656887:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b8478d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1745:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a10 expref: 139 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.656939:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293819776 00000100:00100000:0.0:1782487582.656944:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293819776 00010000:00010000:0.0:1782487582.656966:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b847bfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x176e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b21 expref: 168 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.657002:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293819136 00000100:00100000:0.0:1782487582.657007:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293819136 00010000:00010000:0.0:1782487582.657025:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056f108bd/0x66475b4e8b8478c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a09 expref: 141 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.657051:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293819904 00000100:00100000:0.0:1782487582.657055:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293819904 00010000:00010000:0.0:1782487582.657065:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 142 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.657081:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5870 00000100:00100000:0.0:1782487582.657089:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2361:x1869066293819520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.657096:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.657103:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 142 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657117:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 142 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657139:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000560a9ad5/0x66475b4e8b847f91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c39 expref: 142 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657164:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.657201:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2361:x1869066293819520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.657215:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5870 00000100:00100000:0.0:1782487582.657250:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5872 00000100:00100000:0.0:1782487582.657262:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2361:x1869066293819264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.657274:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.657281:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000672ddcc3/0x66475b4e8b847be7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b0c expref: 135 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657290:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000672ddcc3/0x66475b4e8b847be7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b0c expref: 135 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657301:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000672ddcc3/0x66475b4e8b847be7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1746:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b0c expref: 135 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657310:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657313:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657316:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f4b7c3a/0x66475b4e8b8525a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657338:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f4b7c3a/0x66475b4e8b8525a0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1746:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657358:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.657385:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2361:x1869066293819264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 119us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.657396:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5872 00000100:00100000:0.0:1782487582.657415:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5874 00000100:00100000:0.0:1782487582.657426:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+138:2362:x1869066293819136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.657438:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.657445:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056f108bd/0x66475b4e8b8478c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a09 expref: 138 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657467:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056f108bd/0x66475b4e8b8478c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a09 expref: 138 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657481:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f108bd/0x66475b4e8b8478c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1744:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471a09 expref: 138 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657494:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657497:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657500:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cecbe3e/0x66475b4e8b852592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657509:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cecbe3e/0x66475b4e8b852592 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1744:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657522:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.657542:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2362:x1869066293819136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.657558:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5874 00000100:00100000:0.0:1782487582.657647:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5876 00000100:00100000:0.0:1782487582.657660:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2363:x1869066293819904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.657671:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.657677:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657688:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657718:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb49cd2/0x66475b4e8b8476a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1743:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471961 expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657748:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657760:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.657771:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657810:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657850:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.657877:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2363:x1869066293819904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 220us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.657891:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5876 00000100:00100000:0.0:1782487582.657918:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5877 00000100:00100000:0.0:1782487582.657934:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2362:x1869066293819648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.657947:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.657956:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000836db8cf/0x66475b4e8b847f9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x176e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c47 expref: 122 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.657978:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000836db8cf/0x66475b4e8b847f9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x176e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c47 expref: 122 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658004:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000836db8cf/0x66475b4e8b847f9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x176e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c47 expref: 122 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658018:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.658023:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x176e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.658029:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001422f326/0x66475b4e8b852576 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x176e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658043:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001422f326/0x66475b4e8b852576 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x176e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658066:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.658094:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2362:x1869066293819648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.658103:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5877 00010000:00010000:0.0:1782487582.658143:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658152:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658159:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658165:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.658169:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658191:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658203:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb57fd34300) 00010000:00010000:0.0:1782487582.658206:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.658211:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.658217:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b8525d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661658:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.661666:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b8525bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661685:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.661691:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b8525bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661701:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b8525bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661717:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b8525bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661733:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b8525bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661760:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.661764:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.661767:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.661784:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661794:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661804:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661818:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.661823:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661831:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661843:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4e6ebce00) 00010000:00010000:0.0:1782487582.661848:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.661852:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661869:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b852617 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.661921:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5883 00000100:00100000:0.0:1782487582.661939:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2360:x1869066293821440:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.661955:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.661965:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a822a1c/0x66475b4e8b847f98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1748:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c40 expref: 134 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661980:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a822a1c/0x66475b4e8b847f98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1748:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c40 expref: 134 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.661996:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662000:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662005:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662014:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662030:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.662068:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2360:x1869066293821440:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 134us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.662077:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5883 00000100:00100000:0.0:1782487582.662099:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5884 00000100:00100000:0.0:1782487582.662109:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2360:x1869066293821696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.662118:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.662124:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662145:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 135 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662165:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662171:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662178:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662200:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662249:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.662281:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2360:x1869066293821696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.662293:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5884 00000100:00100000:0.0:1782487582.662315:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5885 00000100:00100000:0.0:1782487582.662327:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2360:x1869066293820032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.662341:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.662351:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 134 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662367:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 134 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662395:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662400:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662410:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662426:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662457:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.662495:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2360:x1869066293820032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.662503:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5885 00000100:00100000:0.0:1782487582.662521:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5886 00000100:00100000:0.0:1782487582.662530:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+169:2360:x1869066293820544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.662539:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.662545:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed8d00f8/0x66475b4e8b848517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e7e expref: 169 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662560:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed8d00f8/0x66475b4e8b848517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e7e expref: 169 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662672:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8d00f8/0x66475b4e8b848517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1777:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e7e expref: 169 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662688:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662692:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662697:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b852602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662703:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b852602 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662729:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.662758:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+168:2360:x1869066293820544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 229us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.662778:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5886 00000100:00100000:0.0:1782487582.662799:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5887 00000100:00100000:0.0:1782487582.662813:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+167:2360:x1869066293820800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.662826:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.662834:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000381170ff/0x66475b4e8b84854f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e93 expref: 167 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662846:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000381170ff/0x66475b4e8b84854f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e93 expref: 167 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662862:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662870:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.662878:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8525ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662901:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8525ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.662918:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.662952:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+167:2360:x1869066293820800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.662958:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5887 00000100:00100000:0.0:1782487582.662979:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5888 00000100:00100000:0.0:1782487582.662989:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+166:2360:x1869066293821056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.663003:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.663011:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a052f195/0x66475b4e8b8485f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea8 expref: 166 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663029:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a052f195/0x66475b4e8b8485f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea8 expref: 166 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663049:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a052f195/0x66475b4e8b8485f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea8 expref: 166 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663064:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.663068:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.663073:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000765003ff/0x66475b4e8b8525c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663081:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000765003ff/0x66475b4e8b8525c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663114:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.663143:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+165:2360:x1869066293821056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 153us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.663163:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5888 00000100:00100000:0.0:1782487582.663185:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5889 00000100:00100000:0.0:1782487582.663200:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+164:2360:x1869066293821568:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.663211:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.663220:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b848502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e69 expref: 164 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663266:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b848502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e69 expref: 164 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663288:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b848502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1772:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e69 expref: 164 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663302:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.663308:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.663317:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8525fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663327:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8525fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1772:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663351:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.663372:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+163:2360:x1869066293821568:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.663390:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5889 00010000:00010000:0.0:1782487582.663527:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663537:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663544:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663554:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.663559:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663649:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663661:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb57fd34b00) 00010000:00010000:0.0:1782487582.663664:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.663668:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663675:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b852633 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663701:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.663706:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663713:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.663716:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663724:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663736:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663748:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003504fefe/0x66475b4e8b8525f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663770:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.663773:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.663777:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.663804:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2f0ea7/0x66475b4e8b848548 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1774:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e8c expref: 162 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.663815:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c0a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299159424:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.663833:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663866:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663881:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663890:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663897:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85257d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.663928:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.664088:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb449acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299156736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13287us (13364us total) trans 8589939747 rc 0/0 00000100:00100000:0.0:1782487582.664103:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15429 00000100:00100000:0.0:1782487582.664128:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293822208 00000100:00100000:0.0:1782487582.664133:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293822208 00010000:00010000:0.0:1782487582.664156:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b84855d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x174c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e9a expref: 133 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.664177:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293822336 00000100:00100000:0.0:1782487582.664182:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293822336 00010000:00010000:0.0:1782487582.664201:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b848525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e85 expref: 134 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.664222:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5890 00000100:00100000:0.0:1782487582.664246:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066293822208:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.664259:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.664266:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b84855d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e9a expref: 134 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664284:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b84855d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e9a expref: 134 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664302:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.664309:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.664318:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099978ab5/0x66475b4e8b85264f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664331:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099978ab5/0x66475b4e8b85264f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x174c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664362:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.664387:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066293822208:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 153us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.664406:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5890 00000100:00100000:0.0:1782487582.664433:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5891 00000100:00100000:0.0:1782487582.664447:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2362:x1869066293822336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.664460:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.664469:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b848525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e85 expref: 132 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664482:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b848525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x174e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e85 expref: 132 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664512:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b848525 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x174e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471e85 expref: 132 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664531:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.664536:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.664546:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008749ba9/0x66475b4e8b852648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664648:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008749ba9/0x66475b4e8b852648 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x174e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664667:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.664693:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2362:x1869066293822336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 250us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.664701:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5891 00000004:00080000:0.0:1782487582.664746:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fc61c00/2, rc 0, transno 8589940438 00000100:00100000:0.0:1782487582.664755:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299160192:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.664769:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545fd180/2, rc 0, transno 8589940435 00000100:00100000:0.0:1782487582.664774:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299158656:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.664784:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545fce00/2, rc 0, transno 8589940437 00000100:00100000:0.0:1782487582.664787:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299159168:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.664800:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4545ffb80/2, rc 0, transno 8589940441 00000100:00100000:0.0:1782487582.664804:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299159040:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.664820:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711880/2, rc 0, transno 8589939745 00000100:00100000:0.0:1782487582.664825:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157376:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.664840:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547710a80/2, rc 0, transno 8589939742 00000100:00100000:0.0:1782487582.664846:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157248:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.664889:0:213211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b847bee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1747:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471b13 expref: 130 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.664909:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299158528:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.664937:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664957:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664966:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664974:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.664984:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab69ba4/0x66475b4e8b852599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.665018:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.665169:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3314:x1869066299157888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12843us (13093us total) trans 8589939750 rc 0/0 00000100:00100000:0.0:1782487582.665181:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15432 00000100:00100000:0.0:1782487582.665210:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.665265:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.665286:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e7cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.665312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.665338:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711500/2, rc 0, transno 8589939750 00000100:00100000:0.0:1782487582.665352:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299157888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.665368:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782487582.665379:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299161984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.665410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.665432:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e7cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.665465:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.665483:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e7cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299163008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.665525:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162368 00000100:00100000:0.0:1782487582.665528:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162368 00000100:00100000:0.0:1782487582.665552:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162880 00000100:00100000:0.0:1782487582.665556:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162880 00000100:00100000:0.0:1782487582.665662:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299161984 00000100:00100000:0.0:1782487582.665668:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299161984 00000100:00100000:0.0:1782487582.665695:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162240 00000100:00100000:0.0:1782487582.665701:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162240 00000100:00100000:0.0:1782487582.665726:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162496 00000100:00100000:0.0:1782487582.665732:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162496 00000100:00100000:0.0:1782487582.665758:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162752 00000100:00100000:0.0:1782487582.665763:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162752 00000100:00100000:0.0:1782487582.665782:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299162624 00000100:00100000:0.0:1782487582.665788:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299162624 00000100:00100000:0.0:1782487582.665817:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15448 00000100:00100000:0.0:1782487582.665829:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3314:x1869066299162368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.665847:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6012 count 1 00010000:00010000:0.0:1782487582.665864:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.665892:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.665913:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.665918:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.665927:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.665962:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.665979:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.666009:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299163264:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.666067:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.666114:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15450 00000100:00100000:0.0:1782487582.666122:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3314:x1869066299161984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.666140:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6010 count 1 00010000:00010000:0.0:1782487582.666154:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666173:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000603561c6/0x66475b4e8b848eef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47211e expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666205:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.666215:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.666226:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666269:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000603561c6/0x66475b4e8b848eef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47211e expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666284:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000603561c6/0x66475b4e8b848eef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47211e expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.666300:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb579754380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299163520:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.666332:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83840 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.666348:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.666373:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299163008 00000100:00100000:0.0:1782487582.666381:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299163008 00000100:00100000:0.0:1782487582.666409:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15453 00000100:00100000:0.0:1782487582.666422:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+82:3317:x1869066299162752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.666437:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5967 count 1 00010000:00010000:0.0:1782487582.666454:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666468:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 129 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666502:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487582.666505:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.666512:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666548:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 129 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.666924:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 129 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.666956:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4892f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299163904:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.667227:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff836c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.667260:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667279:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667289:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667313:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b8525b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667341:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.667647:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299158912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14547us (14737us total) trans 8589940443 rc 0/0 00000100:00100000:0.0:1782487582.667662:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15436 00010000:00010000:0.0:1782487582.667811:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add52dd4/0x66475b4e8b847fa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471c4e expref: 131 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.667828:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299160960:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.667849:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095dbbe5a/0x66475b4e8b847e17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1749:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471bbb expref: 129 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.667869:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299161088:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.667889:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667905:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667914:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667927:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667957:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b852609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.667977:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.668172:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3315:x1869066299160832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12374us (12502us total) trans 8589939751 rc 0/0 00000100:00100000:0.0:1782487582.668183:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15444 00000100:00100000:0.0:1782487582.668222:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15458 00000100:00100000:0.0:1782487582.668243:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3317:x1869066299164416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.668259:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5970 count 1 00010000:00010000:0.0:1782487582.668275:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668292:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 130 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668310:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1752:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.668317:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.668323:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668356:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 130 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668375:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 130 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.668397:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4892fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299165184:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.668439:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.668459:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299164928 00000100:00100000:0.0:1782487582.668464:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299164928 00000100:00100000:0.0:1782487582.668495:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299164800 00000100:00100000:0.0:1782487582.668500:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299164800 00000100:00100000:0.0:1782487582.668532:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15461 00000100:00100000:0.0:1782487582.668546:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:3315:x1869066299164800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.668560:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6014 count 1 00010000:00010000:0.0:1782487582.668689:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668729:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b84943d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4722bb expref: 159 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668750:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.668758:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.668765:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668808:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b84943d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722bb expref: 159 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.668828:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b84943d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722bb expref: 159 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.668864:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4892f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299165824:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.668892:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.668914:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299165568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.668947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.671645:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671658:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671666:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671673:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.671679:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671688:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671705:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4e6ebc000) 00010000:00010000:0.0:1782487582.671708:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.671713:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.671721:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852680 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.677109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.677155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.677183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.677211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.677297:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293822848 00000100:00100000:0.0:1782487582.677301:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293822848 00010000:00010000:0.0:1782487582.677341:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.677376:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5893 00000100:00100000:0.0:1782487582.677390:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2363:x1869066293822848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.677401:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.677408:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677426:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677462:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.677467:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.677473:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677487:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677514:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.677573:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2363:x1869066293822848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.677591:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5893 00000100:00100000:0.0:1782487582.677655:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4892f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299165824:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.677671:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.677705:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb579754380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299163520:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.677718:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.677751:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4892f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299163904:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.677770:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677808:0:190931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b8490fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721b1 expref: 119 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.677825:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299163264:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.677836:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677846:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677851:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677859:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677875:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.677893:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.678109:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:3314:x1869066299162368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12282us (12848us total) trans 8589940444 rc 0/0 00000100:00100000:0.0:1782487582.678119:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15448 00010000:00010000:0.0:1782487582.678141:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.678148:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.678162:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.678167:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.678176:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.678188:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.678194:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85268e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.678211:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.678215:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.678218:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.678257:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fc61500/2, rc 0, transno 8589940444 00000100:00100000:0.0:1782487582.678266:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.679078:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487582.679105:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299166208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.679151:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.680218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.680940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.681065:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681076:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681096:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681113:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.681120:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681131:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681153:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb57fd34000) 00010000:00010000:0.0:1782487582.681159:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.681166:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681181:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b85271a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681217:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681252:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681272:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681289:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.681296:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681317:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681343:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa69:0x0].0x0 (ffff9cb4e6ebc900) 00010000:00010000:0.0:1782487582.681349:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.681355:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681365:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019a000/0x66475b4e8b852713 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681398:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681420:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681432:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681440:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.681448:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681457:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681475:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4e6ebc000) 00010000:00010000:0.0:1782487582.681480:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.681485:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681506:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85272f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.681562:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5898 00000100:00100000:0.0:1782487582.681578:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2360:x1869066293824640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.681595:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.681623:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b848adc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471f8f expref: 132 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681648:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b848adc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x174a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471f8f expref: 132 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681670:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b848adc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x174a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471f8f expref: 132 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681686:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.681717:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+131:2360:x1869066293824640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.681743:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5898 00000100:00100000:0.0:1782487582.681770:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5901 00000100:00100000:0.0:1782487582.681786:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2360:x1869066293825280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.681802:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.681812:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 129 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681844:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 129 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681875:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.681885:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.681896:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681921:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.681952:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.681984:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2360:x1869066293825280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.682001:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5901 00000100:00100000:0.0:1782487582.682025:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5902 00000100:00100000:0.0:1782487582.682037:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+159:2363:x1869066293823104:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.682055:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.682063:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f0f4e48/0x66475b4e8b849428 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722b4 expref: 159 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682085:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f0f4e48/0x66475b4e8b849428 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x177f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722b4 expref: 159 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682116:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f0f4e48/0x66475b4e8b849428 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x177f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722b4 expref: 159 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682145:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682155:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682164:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cfb3f4e/0x66475b4e8b8526b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682193:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cfb3f4e/0x66475b4e8b8526b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x177f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682225:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.682258:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2363:x1869066293823104:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 224us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.682280:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5902 00000100:00100000:0.0:1782487582.682301:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5905 00000100:00100000:0.0:1782487582.682313:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+157:2363:x1869066293825408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.682322:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.682334:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b8495a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x177d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722f3 expref: 157 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682350:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b8495a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x177d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722f3 expref: 157 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682382:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b8495a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x177d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722f3 expref: 157 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682409:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682419:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x177d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682428:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8526e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682454:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8526e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x177d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682482:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.682500:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+156:2363:x1869066293825408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 189us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.682517:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5905 00000100:00100000:0.0:1782487582.682538:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5908 00000100:00100000:0.0:1782487582.682550:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2363:x1869066293823488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.682561:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.682568:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 128 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682596:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 128 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682642:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86d6c45/0x66475b4e8b8485bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x174f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a471ea1 expref: 128 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682654:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682658:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x174f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.682664:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682685:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682719:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.682743:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2363:x1869066293823488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 192us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.682758:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5908 00010000:00010000:0.0:1782487582.682789:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682813:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682825:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682836:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c6e25a/0x66475b4e8b8526f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.682858:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.683043:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+82:3315:x1869066299164800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14498us (14601us total) trans 8589940445 rc 0/0 00000100:00100000:0.0:1782487582.683059:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15461 00010000:00010000:0.0:1782487582.683088:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683098:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683107:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683114:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b8526a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x177a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683125:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1782487582.683662:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+83:3314:x1869066299161984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17537us (18250us total) trans 8589940446 rc 0/0 00000100:00100000:0.0:1782487582.683679:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15450 00000100:00100000:0.0:1782487582.683775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.683809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.683862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.683904:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5910 00000100:00100000:0.0:1782487582.683917:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2362:x1869066293825920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.683931:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.683943:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255d8911/0x66475b4e8b849aa3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472451 expref: 116 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683959:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255d8911/0x66475b4e8b849aa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472451 expref: 116 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.683987:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.683995:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.684007:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b85274b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684024:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b85274b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684045:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.684076:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2362:x1869066293825920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.684084:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5910 00000004:00080000:0.0:1782487582.684123:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770d500/2, rc 0, transno 8589940446 00000100:00100000:0.0:1782487582.684138:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299161984:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.684154:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e7cf5500/2, rc 0, transno 8589940448 00000100:00100000:0.0:1782487582.684162:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162496:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.684181:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e7cf6680/2, rc 0, transno 8589939755 00000100:00100000:0.0:1782487582.684191:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299163008:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.684208:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e7cf7100/2, rc 0, transno 8589939756 00000100:00100000:0.0:1782487582.684215:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299162880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.684301:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4551b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299166848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.684344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.684388:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb472811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299167360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.684422:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.684464:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684478:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684635:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684651:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b8526bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x174f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684659:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.684806:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+89:3317:x1869066299162752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18387us (19305us total) trans 8589939757 rc 0/0 00000100:00100000:0.0:1782487582.684812:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15453 00000100:00100000:0.0:1782487582.684832:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15467 00000100:00100000:0.0:1782487582.684844:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3317:x1869066299166720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.684856:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6016 count 1 00010000:00010000:0.0:1782487582.684869:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85279f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684890:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 155 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684904:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001199be3e/0x66475b4e8b849abf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47246d expref: 115 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684925:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1780:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.684930:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.684933:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85279f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684953:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001199be3e/0x66475b4e8b849abf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47246d expref: 115 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.684975:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001199be3e/0x66475b4e8b849abf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47246d expref: 115 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.684993:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4551b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299167616:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.685041:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 155 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685066:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 155 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.685083:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4551b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299167744:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.685106:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.685159:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15468 00000100:00100000:0.0:1782487582.685171:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+88:3314:x1869066299167360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.685191:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5975 count 1 00010000:00010000:0.0:1782487582.685210:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685246:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 124 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685259:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1757:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.685263:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.685272:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685303:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 124 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685332:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 124 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.685374:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4551b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299168000:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.685420:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.685578:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299166976 00000100:00100000:0.0:1782487582.685585:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299166976 00000100:00100000:0.0:1782487582.685630:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299167872 00000100:00100000:0.0:1782487582.685638:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299167872 00000100:00100000:0.0:1782487582.685659:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299168128 00000100:00100000:0.0:1782487582.685666:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299168128 00000100:00100000:0.0:1782487582.685691:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15470 00000100:00100000:0.0:1782487582.685701:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3317:x1869066299167104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.685716:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6019 count 1 00010000:00010000:0.0:1782487582.685730:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685758:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b849c1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4724cf expref: 155 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685782:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1783:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.685790:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.685796:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685828:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b849c1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724cf expref: 155 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.685851:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b849c1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724cf expref: 155 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.685875:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299168512:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.685922:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.685955:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15473 00000100:00100000:0.0:1782487582.685968:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+91:3316:x1869066299168128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.685990:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5976 count 1 00010000:00010000:0.0:1782487582.686005:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686027:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 124 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686044:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1758:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.686049:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.686055:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686085:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 124 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686103:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 124 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.686148:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299168896:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.686180:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83e40 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.686211:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007348a450/0x66475b4e8b848ecc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1752:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472109 expref: 126 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.686254:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4892fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299165184:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.686275:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686295:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686317:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686344:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686354:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b8526e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.686375:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.686696:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299169152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.686741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.686802:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4551b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299167616:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.686820:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4551b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299167744:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.686845:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85279f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1780:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.686930:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3317:x1869066299164416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18697us (19039us total) trans 8589939759 rc 0/0 00000100:00100000:0.0:1782487582.686950:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15458 00000004:00080000:0.0:1782487582.686984:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e7cf4000/2, rc 0, transno 8589939759 00000100:00100000:0.0:1782487582.686999:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299164416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.687046:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782487582.687058:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299169664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.687101:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.687179:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44b4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299169792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.687217:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.687267:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299169792 00000100:00100000:0.0:1782487582.687273:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299169792 00000100:00100000:0.0:1782487582.687302:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15478 00000100:00100000:0.0:1782487582.687310:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3317:x1869066299169792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.687322:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5979 count 1 00010000:00010000:0.0:1782487582.687334:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.687347:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cfb3573/0x66475b4e8b849c0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4724d6 expref: 124 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.687355:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x175b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.687358:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x175b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.687362:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.687380:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cfb3573/0x66475b4e8b849c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724d6 expref: 124 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.687390:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cfb3573/0x66475b4e8b849c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724d6 expref: 124 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.687408:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44c31dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299170048:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.687568:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.687654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:0.0:1782487582.687698:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472811180/2, rc 0, transno 8589940450 00000100:00100000:0.0:1782487582.687712:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299165568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.687767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.687796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.687970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.688004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.688032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.688067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.688105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.688131:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293827456 00000100:00100000:0.0:1782487582.688137:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293827456 00000100:00100000:0.0:1782487582.688161:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210105503886 time 7210105612613 state 0x0 ref 1 00000100:00100000:0.0:1782487582.688181:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210105712613 time 7210105612613 state 0x1 ref 1 00000100:00100000:0.0:1782487582.688200:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293827328 00000100:00100000:0.0:1782487582.688206:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293827328 00000100:00100000:0.0:1782487582.688226:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210105712613 time 7210105612613 state 0x1 ref 2 00000100:00100000:0.0:1782487582.688263:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210109752212 time 7210109652212 state 0x1 ref 2 00000100:00100000:0.0:1782487582.688283:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+508:293429:x1869066293827456:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.688317:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.688336:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852783 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d40 expref: 508 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688358:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb46f434b00) 00010000:00010000:0.0:1782487582.688362:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.688404:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688429:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b852282 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c3d expref: 123 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688444:0:213218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688479:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b852282 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c3d expref: 123 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688584:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49de00/0x66475b4e8b852282 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c3d expref: 123 pid: 213684 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.688631:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299170560:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.688672:0:213218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83540 going to sleep for 11 seconds 00000004:00080000:0.0:1782487582.688703:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e7cf6a00/2, rc 0, transno 8589940451 00000100:00100000:0.0:1782487582.688717:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299165056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.688778:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5913 00000100:00100000:0.0:1782487582.688791:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+156:2362:x1869066293826816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.688805:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.688816:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 156 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688839:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 156 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688862:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b8495b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1780:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472301 expref: 156 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.688892:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.688916:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2362:x1869066293826816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 129us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.688930:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5913 00000100:00100000:0.0:1782487582.688986:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5915 00000100:00100000:0.0:1782487582.689000:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2363:x1869066293826944:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.689016:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.689025:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 126 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689043:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 126 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689064:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.689072:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.689083:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689111:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689140:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.689167:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2363:x1869066293826944:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.689176:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5915 00010000:00010000:0.0:1782487582.689216:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392d1371/0x66475b4e8b849651 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1757:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47234e expref: 125 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.689251:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4551b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299168000:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.689278:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689295:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689316:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689344:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689365:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77d2844/0x66475b4e8b8527a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689386:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.689736:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:3314:x1869066299167360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4566us (5313us total) trans 8589939761 rc 0/0 00000100:00100000:0.0:1782487582.689750:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15468 00010000:00010000:0.0:1782487582.689798:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689816:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689840:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689862:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.689870:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689893:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689911:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb45a514d00) 00010000:00010000:0.0:1782487582.689918:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.689924:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689936:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec400/0x66475b4e8b85277c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.689967:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.689983:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293827968 00000100:00100000:0.0:1782487582.689989:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293827968 00010000:00010000:0.0:1782487582.690014:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b849c1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724cf expref: 155 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.690048:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293828096 00000100:00100000:0.0:1782487582.690054:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293828096 00010000:00010000:0.0:1782487582.690073:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf2f6cc/0x66475b4e8b8490f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721aa expref: 125 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.690101:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293828224 00000100:00100000:0.0:1782487582.690107:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293828224 00010000:00010000:0.0:1782487582.690129:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001af94793/0x66475b4e8b849c2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724eb expref: 156 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.690155:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293828480 00000100:00100000:0.0:1782487582.690161:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293828480 00010000:00010000:0.0:1782487582.690183:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b849ab1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x175e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472458 expref: 126 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.690224:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5918 00000100:00100000:0.0:1782487582.690249:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+126:2363:x1869066293828096:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.690265:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.690274:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbf2f6cc/0x66475b4e8b8490f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721aa expref: 126 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690292:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbf2f6cc/0x66475b4e8b8490f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721aa expref: 126 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690328:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf2f6cc/0x66475b4e8b8490f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1756:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4721aa expref: 126 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690350:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.690360:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.690366:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690389:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690436:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.690460:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+125:2363:x1869066293828096:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 223us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.690476:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5918 00000100:00100000:0.0:1782487582.690570:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5920 00000100:00100000:0.0:1782487582.690584:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2363:x1869066293828352:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.690599:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.690652:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 123 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690667:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 123 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690682:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.690686:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.690691:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690707:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690737:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.690758:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2363:x1869066293828352:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.690785:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5920 00000004:00080000:0.0:1782487582.690854:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472810e00/2, rc 0, transno 8589939762 00000100:00100000:0.0:1782487582.690870:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299167232:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.690928:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.690935:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b8527ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690943:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92c600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.690947:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b8527ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690956:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b8527ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690969:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b8527ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690977:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e1ba834/0x66475b4e8b8527ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x175a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.690992:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.690996:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691004:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.691009:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691018:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691030:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691037:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8527c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691055:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.691058:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.691061:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.691073:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782487582.691084:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299170944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.691123:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.691180:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b849c1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724cf expref: 154 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.691200:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299168512:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.691220:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691258:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691284:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691306:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691332:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab69ba4/0x66475b4e8b8527bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.691358:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.692473:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:3317:x1869066299167104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6771us (7882us total) trans 8589940455 rc 0/0 00000100:00100000:0.0:1782487582.692786:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15470 00010000:00010000:0.0:1782487582.693139:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.693148:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b8527e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.693173:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.693181:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b8527e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.693197:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b8527e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.693222:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b8527e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.693249:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b8527e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.693271:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.693275:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.693279:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.693310:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4551b1c00/2, rc 0, transno 8589940455 00000100:00100000:0.0:1782487582.693325:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4551b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299167104:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.693346:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472812d80/2, rc 0, transno 8589940456 00000100:00100000:0.0:1782487582.693356:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299166720:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.693442:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299171968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.693474:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.693518:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782487582.693526:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299171840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.693553:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.694006:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293829120 00000100:00100000:0.0:1782487582.694012:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293829120 00010000:00010000:0.0:1782487582.694041:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c86b5/0x66475b4e8b8495b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722fa expref: 123 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.694081:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5926 00000100:00100000:0.0:1782487582.694097:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2363:x1869066293829120:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.694107:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.694113:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c86b5/0x66475b4e8b8495b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722fa expref: 123 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694128:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c86b5/0x66475b4e8b8495b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722fa expref: 123 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694160:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c86b5/0x66475b4e8b8495b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1759:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4722fa expref: 123 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694174:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.694182:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.694188:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694196:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694224:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.694266:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2363:x1869066293829120:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.694277:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5926 00010000:00010000:0.0:1782487582.694509:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694522:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694538:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694552:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694568:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.694815:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+99:3317:x1869066299169664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7645us (7716us total) trans 8589939766 rc 0/0 00000100:00100000:0.0:1782487582.694824:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15477 00010000:00010000:0.0:1782487582.694846:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.694850:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694859:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.694864:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694873:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694889:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694897:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354c7c58/0x66475b4e8b8527ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.694917:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.694921:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.694925:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.694953:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44c31f480/2, rc 0, transno 8589939766 00000100:00100000:0.0:1782487582.694969:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299169664:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.695004:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44c31e680/2, rc 0, transno 8589940458 00000100:00100000:0.0:1782487582.695013:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299169152:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.695030:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472811c00/2, rc 0, transno 8589939761 00000100:00100000:0.0:1782487582.695041:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299167360:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.695057:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4551b2300/2, rc 0, transno 8589940454 00000100:00100000:0.0:1782487582.695066:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4551b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299166848:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.695081:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb472813800/2, rc 0, transno 8589940453 00000100:00100000:0.0:1782487582.695086:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb472813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299166208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.695170:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299173120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.695206:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.695534:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299173248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.695591:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299173376 00000100:00100000:0.0:1782487582.695595:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299173376 00000100:00100000:0.0:1782487582.695909:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.695962:0:190931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b8495c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1758:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47230f expref: 121 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.695979:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299168896:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.695999:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696023:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696034:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696049:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696062:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696087:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.696308:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+101:3316:x1869066299168128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10344us (10887us total) trans 8589939767 rc 0/0 00000100:00100000:0.0:1782487582.696316:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15473 00010000:00010000:0.0:1782487582.696335:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.696340:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696349:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.696352:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696361:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696375:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696383:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b8527d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696400:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.696404:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.696409:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.696437:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cfb3573/0x66475b4e8b849c0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x175b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4724d6 expref: 120 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.696455:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44c31dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299170048:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.696471:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696690:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696700:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696708:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696721:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000085ba379/0x66475b4e8b8527f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.696736:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.696956:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+102:3317:x1869066299169792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9647us (9743us total) trans 8589939768 rc 0/0 00000100:00100000:0.0:1782487582.696964:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15478 00000100:00100000:0.0:1782487582.697422:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299174400 00000100:00100000:0.0:1782487582.697427:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299174400 00000100:00100000:0.0:1782487582.697456:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15495 00000100:00100000:0.0:1782487582.697466:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3316:x1869066299174400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.697547:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5989 count 1 00010000:00010000:0.0:1782487582.697561:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697577:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e333076/0x66475b4e8b84a696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472825 expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697586:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1765:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.697589:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.697593:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697652:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e333076/0x66475b4e8b84a696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472825 expref: 120 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697669:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e333076/0x66475b4e8b84a696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472825 expref: 120 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.697681:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299174528:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.697725:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.697752:0:213218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299170560:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.697765:0:213218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697785:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697793:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697800:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697807:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.697811:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697817:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697828:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4e6ebc800) 00010000:00010000:0.0:1782487582.697832:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.697893:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697901:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852816 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697929:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697936:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697944:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697956:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.697960:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697972:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.697988:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4e6ebc200) 00010000:00010000:0.0:1782487582.697993:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.697996:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.698002:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b852839 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.698550:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293830400 00000100:00100000:0.0:1782487582.698556:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293830400 00010000:00010000:0.0:1782487582.698580:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000382a9246/0x66475b4e8b84a03e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1761:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4725e7 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.698645:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5929 00000100:00100000:0.0:1782487582.698662:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2362:x1869066293830400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.698676:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.698685:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000382a9246/0x66475b4e8b84a03e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4725e7 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.698715:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000382a9246/0x66475b4e8b84a03e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4725e7 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.698735:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.698740:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.698748:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.698771:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.698803:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.698965:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57b51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2362:x1869066293830400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.698980:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5929 00010000:00010000:0.0:1782487582.699479:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.699649:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699695:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.699702:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699717:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699744:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699756:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000730939a4/0x66475b4e8b85284e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699775:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.699781:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8527fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699793:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.699799:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8527fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699809:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8527fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699824:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8527fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699832:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b8527fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699926:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.699930:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699935:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ecc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.699941:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699957:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699972:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852855 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699980:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852855 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x175c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.699997:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.700000:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.700003:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.700012:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.700690:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299172224:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.700709:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299172352:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.700737:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85286a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.700951:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5471d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299173632:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.700967:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701011:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b85282b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701021:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b85282b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701032:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b85282b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701042:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e952796a/0x66475b4e8b85282b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701058:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.701293:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+95:3315:x1869066299170688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11572us (11695us total) trans 8589940460 rc 0/0 00000100:00100000:0.0:1782487582.701303:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15481 00000100:00100000:0.0:1782487582.701331:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15496 00000100:00100000:0.0:1782487582.701346:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+104:3315:x1869066299174784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.701368:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5992 count 1 00010000:00010000:0.0:1782487582.701398:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701421:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfbd85b4/0x66475b4e8b84aa63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472952 expref: 119 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701445:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1768:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.701453:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.701465:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701517:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfbd85b4/0x66475b4e8b84aa63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472952 expref: 119 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701542:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfbd85b4/0x66475b4e8b84aa63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472952 expref: 120 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.701574:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299175168:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.701658:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.701683:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293831936 00000100:00100000:0.0:1782487582.701690:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293831936 00010000:00010000:0.0:1782487582.701715:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b84a156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472626 expref: 122 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.701772:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5932 00000100:00100000:0.0:1782487582.701788:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2363:x1869066293831040:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.701806:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.701817:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000233b281f/0x66475b4e8b84a69d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x178b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47282c expref: 116 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701837:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000233b281f/0x66475b4e8b84a69d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x178b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47282c expref: 116 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701870:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.701879:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.701891:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701902:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.701919:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.701950:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2363:x1869066293831040:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 164us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.701965:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5932 00000100:00100000:0.0:1782487582.701994:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5935 00000100:00100000:0.0:1782487582.702010:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2363:x1869066293831808:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.702028:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.702038:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b849c6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x175d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472500 expref: 122 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702060:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b849c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x175d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472500 expref: 122 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702090:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b849c6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x175d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472500 expref: 122 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702121:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x175d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702129:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x175d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702141:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702160:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702198:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.702225:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2363:x1869066293831808:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 218us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.702252:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5935 00000100:00100000:0.0:1782487582.702275:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5937 00000100:00100000:0.0:1782487582.702291:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2363:x1869066293832320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.702308:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.702318:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b84a67a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47281e expref: 121 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702337:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b84a67a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47281e expref: 121 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702361:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b84a67a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1764:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47281e expref: 121 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702388:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702396:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702403:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702428:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702466:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.702494:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2363:x1869066293832320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 205us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.702509:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5937 00000100:00100000:0.0:1782487582.702534:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5939 00000100:00100000:0.0:1782487582.702549:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2363:x1869066293831168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.702561:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.702571:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca825abe/0x66475b4e8b84a52a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4727d1 expref: 120 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702603:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca825abe/0x66475b4e8b84a52a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4727d1 expref: 120 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702638:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca825abe/0x66475b4e8b84a52a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1762:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4727d1 expref: 120 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702649:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702654:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702663:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702674:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702711:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.702740:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2363:x1869066293831168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 192us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.702758:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5939 00000100:00100000:0.0:1782487582.702783:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5941 00000100:00100000:0.0:1782487582.702799:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2363:x1869066293831680:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.702813:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.702825:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5e9e458/0x66475b4e8b84a1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x178a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472649 expref: 111 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702877:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5e9e458/0x66475b4e8b84a1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x178a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472649 expref: 111 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702895:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e9e458/0x66475b4e8b84a1b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x178a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472649 expref: 111 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702916:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702923:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.702929:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702936:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.702964:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.702991:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2363:x1869066293831680:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.703012:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5941 00000100:00100000:0.0:1782487582.703055:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5943 00000100:00100000:0.0:1782487582.703071:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2363:x1869066293831936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.703087:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.703097:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b84a156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472626 expref: 117 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703141:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b84a156 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472626 expref: 117 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703172:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b84a156 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1763:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472626 expref: 117 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703202:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.703207:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.703217:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e3c957/0x66475b4e8b85287f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703246:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e3c957/0x66475b4e8b85287f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703281:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.703310:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2363:x1869066293831936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 241us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.703329:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5943 00010000:00010000:0.0:1782487582.703357:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703377:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703402:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703426:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703447:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.703718:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+105:3316:x1869066299172992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8497us (8558us total) trans 8589939772 rc 0/0 00000100:00100000:0.0:1782487582.703728:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15490 00010000:00010000:0.0:1782487582.703782:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782487582.703788:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703797:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.703801:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703811:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703837:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703859:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af8a8d92/0x66475b4e8b852878 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x175d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703891:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.703896:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703905:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.703911:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703936:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703968:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.703995:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b852863 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x178b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704025:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.704031:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704058:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.704065:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704082:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704114:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704124:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920f8b01/0x66475b4e8b852886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704149:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782487582.704156:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b85288d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704175:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.704181:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b85288d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704203:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b85288d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x178c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704381:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b85288d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x178c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704449:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b85288d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x178c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704539:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782487582.704545:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b85289b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704565:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.704570:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b85289b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704588:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b85289b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704658:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b85289b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704681:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e72bfd6/0x66475b4e8b85289b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704717:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.704725:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85285c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704754:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.704763:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85285c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704793:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85285c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704821:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85285c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704845:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85285c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704876:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.704883:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704901:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.704907:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704925:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704950:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704963:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e14cc485/0x66475b4e8b852871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.704989:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.704995:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.704999:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.705018:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705040:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705062:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705077:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b8528a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705098:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.705298:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+109:3316:x1869066299174144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8773us (8830us total) trans 8589939775 rc 0/0 00000100:00100000:0.0:1782487582.705313:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15494 00000100:00100000:0.0:1782487582.705337:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15506 00000100:00100000:0.0:1782487582.705352:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+99:3315:x1869066299177216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.705373:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6038 count 1 00010000:00010000:0.0:1782487582.705457:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705474:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b84b488 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472c31 expref: 108 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705507:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1796:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.705516:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.705526:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705562:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b84b488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c31 expref: 108 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.705580:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b84b488 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c31 expref: 108 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.705604:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299177600:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.705677:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.705702:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293833600 00000100:00100000:0.0:1782487582.705707:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293833600 00010000:00010000:0.0:1782487582.705732:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfbd85b4/0x66475b4e8b84aa63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472952 expref: 115 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.705763:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293833856 00000100:00100000:0.0:1782487582.705770:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293833856 00010000:00010000:0.0:1782487582.705794:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006588ab84/0x66475b4e8b84ad5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472a24 expref: 109 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.705813:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293833472 00000100:00100000:0.0:1782487582.705820:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293833472 00010000:00010000:0.0:1782487582.705838:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efc716a9/0x66475b4e8b84a8cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1766:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4728bf expref: 116 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.705856:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293833984 00000100:00100000:0.0:1782487582.705862:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293833984 00010000:00010000:0.0:1782487582.705883:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b84aaef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472960 expref: 149 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.705922:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5946 00000100:00100000:0.0:1782487582.705941:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2362:x1869066293833856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.705958:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.705968:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006588ab84/0x66475b4e8b84ad5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472a24 expref: 109 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706000:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006588ab84/0x66475b4e8b84ad5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472a24 expref: 109 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706033:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.706067:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2362:x1869066293833856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 130us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.706081:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5946 00000100:00100000:0.0:1782487582.706112:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5947 00000100:00100000:0.0:1782487582.706127:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2362:x1869066293833472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.706138:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.706147:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efc716a9/0x66475b4e8b84a8cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4728bf expref: 115 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706166:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efc716a9/0x66475b4e8b84a8cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4728bf expref: 115 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706200:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.706204:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.706210:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8c08b03/0x66475b4e8b8528fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706226:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c08b03/0x66475b4e8b8528fd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1766:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706260:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.706287:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2362:x1869066293833472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.706298:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5947 00000100:00100000:0.0:1782487582.706325:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5949 00000100:00100000:0.0:1782487582.706340:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2362:x1869066293833984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.706351:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.706357:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b84aaef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472960 expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706371:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b84aaef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472960 expref: 148 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706455:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.706464:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x178d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.706475:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706497:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706518:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.706545:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2362:x1869066293833984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 206us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.706557:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5949 00010000:00010000:0.0:1782487582.706628:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfbd85b4/0x66475b4e8b84aa63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1768:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472952 expref: 114 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.706659:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299175168:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.706680:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706692:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706699:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706721:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706737:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b8528f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.706760:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.706943:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+109:3315:x1869066299174784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5600us (5959us total) trans 8589939776 rc 0/0 00000100:00100000:0.0:1782487582.706956:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15496 00010000:00010000:0.0:1782487582.706988:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707009:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707028:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707048:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.707054:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707073:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707097:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4e6ebc400) 00010000:00010000:0.0:1782487582.707101:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.707105:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707118:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446600/0x66475b4e8b8528d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707144:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707157:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707170:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707179:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.707183:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707190:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707201:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa6b:0x0].0x0 (ffff9cb4e6ebcb00) 00010000:00010000:0.0:1782487582.707204:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.707207:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707217:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8528b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa6b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707260:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707281:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707293:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707311:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.707316:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707333:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707357:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb57fd34500) 00010000:00010000:0.0:1782487582.707363:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.707369:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707382:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b8528c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707471:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707489:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707506:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707522:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.707529:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707542:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707552:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa2:0x0].0x0 (ffff9cb46f434b00) 00010000:00010000:0.0:1782487582.707560:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.707565:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852982 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707576:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852982 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707598:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852982 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707653:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707673:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b852801 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707717:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.707723:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707732:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.707737:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707748:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707768:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707789:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b85290b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x178d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.707818:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.707823:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.707827:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.707838:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.707950:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e333076/0x66475b4e8b84a696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1765:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472825 expref: 118 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.707971:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299174528:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.707993:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708020:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708041:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708068:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708086:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082c18462/0x66475b4e8b8528a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708117:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.708286:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:3316:x1869066299174400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10820us (10949us total) trans 8589939777 rc 0/0 00000100:00100000:0.0:1782487582.708305:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15495 00000100:00100000:0.0:1782487582.708325:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15511 00000100:00100000:0.0:1782487582.708337:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3316:x1869066299178496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.708351:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6040 count 1 00010000:00010000:0.0:1782487582.708364:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708378:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af32c560/0x66475b4e8b84b3fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472c00 expref: 145 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708454:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1798:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.708462:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.708470:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708506:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af32c560/0x66475b4e8b84b3fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c00 expref: 145 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708534:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af32c560/0x66475b4e8b84b3fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c00 expref: 145 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.708566:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299179136:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.708597:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.708720:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15513 00000100:00100000:0.0:1782487582.708735:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+111:3315:x1869066299179008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.708754:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6000 count 1 00010000:00010000:0.0:1782487582.708773:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708795:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b84b219 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472b90 expref: 112 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708808:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1770:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.708812:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.708816:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708851:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b84b219 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472b90 expref: 112 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.708873:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b84b219 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472b90 expref: 112 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.708894:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299179392:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.708930:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.709157:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299179520 00000100:00100000:0.0:1782487582.709162:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299179520 00000100:00100000:0.0:1782487582.709195:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15514 00000100:00100000:0.0:1782487582.709207:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+112:3316:x1869066299179520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.709223:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6001 count 1 00010000:00010000:0.0:1782487582.709248:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709262:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 117 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709273:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1771:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.709277:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.709282:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709306:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 117 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709319:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 117 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.709333:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299179648:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.709363:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83e40 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.709381:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709454:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709467:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709493:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.709500:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709508:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709521:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa6c:0x0].0x0 (ffff9cb4e6ebc500) 00010000:00010000:0.0:1782487582.709526:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.709531:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709539:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526c00/0x66475b4e8b85294a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa6c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.709580:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299177600:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.709597:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709665:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709685:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709693:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709699:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.709703:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709716:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709736:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4e6ebcc00) 00010000:00010000:0.0:1782487582.709740:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.709744:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.709750:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85297b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.710819:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293834624 00000100:00100000:0.0:1782487582.710825:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293834624 00010000:00010000:0.0:1782487582.710850:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ceffdb2/0x66475b4e8b84b1d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472b58 expref: 146 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.710882:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293834880 00000100:00100000:0.0:1782487582.710886:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293834880 00010000:00010000:0.0:1782487582.710905:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b84ab20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47296e expref: 113 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.710938:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293835392 00000100:00100000:0.0:1782487582.710943:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293835392 00010000:00010000:0.0:1782487582.710964:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b84b488 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c31 expref: 109 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.711001:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5951 00000100:00100000:0.0:1782487582.711016:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+114:2361:x1869066293834880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.711031:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.711040:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b84ab20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47296e expref: 115 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711070:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b84ab20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47296e expref: 115 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711097:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b84ab20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1769:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47296e expref: 115 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711120:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711134:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711141:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711154:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711175:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.711201:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+114:2361:x1869066293834880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.711225:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5951 00000100:00100000:0.0:1782487582.711256:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5954 00000100:00100000:0.0:1782487582.711271:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2361:x1869066293834496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.711295:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.711305:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026dd1a70/0x66475b4e8b84aae1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47294b expref: 113 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711328:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026dd1a70/0x66475b4e8b84aae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47294b expref: 113 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711359:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026dd1a70/0x66475b4e8b84aae1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1767:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47294b expref: 113 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711385:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711451:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711462:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711474:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711497:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.711522:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2361:x1869066293834496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 253us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.711537:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5954 00000100:00100000:0.0:1782487582.711563:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5957 00000100:00100000:0.0:1782487582.711576:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2361:x1869066293835648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.711593:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.711604:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b84b41f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1797:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c23 expref: 146 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711653:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b84b41f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1797:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c23 expref: 146 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711684:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b84b41f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1797:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c23 expref: 146 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711702:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1797:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711709:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1797:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.711714:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711731:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711771:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.711798:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2361:x1869066293835648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 223us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.711812:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5957 00010000:00010000:0.0:1782487582.711838:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711852:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711887:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711912:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.711947:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.712212:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+105:3315:x1869066299177216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6864us (7120us total) trans 8589940470 rc 0/0 00000100:00100000:0.0:1782487582.712223:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15506 00000100:00100000:0.0:1782487582.712279:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299179392:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.712304:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712334:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.712342:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712351:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.712357:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712367:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712386:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712824:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b852951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712861:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.712866:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712878:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ed600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.712885:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712900:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712930:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712951:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b852920 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.712992:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.712998:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713021:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.713028:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713056:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713087:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713105:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026dcdd59/0x66475b4e8b85292e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713126:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.713130:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.713134:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.713162:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.713170:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713186:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.713195:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713218:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713255:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713269:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8b8809/0x66475b4e8b85299e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713295:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.713299:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713306:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ed800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.713310:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713318:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713330:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852935 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713337:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713359:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.713364:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ded6260b/0x66475b4e8b85293c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713373:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.713377:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded6260b/0x66475b4e8b85293c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713385:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded6260b/0x66475b4e8b85293c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x176d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713470:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ded6260b/0x66475b4e8b85293c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x176d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713493:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded6260b/0x66475b4e8b85293c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x176d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713525:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.713530:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.713536:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.713588:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299179648:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.713840:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.713927:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.713946:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5961 00000100:00100000:0.0:1782487582.713962:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2361:x1869066293836544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.713977:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.713987:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714009:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714044:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b84b49d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1771:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c46 expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714067:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.714073:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.714080:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714090:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714120:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.714150:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2361:x1869066293836544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.714164:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5961 00010000:00010000:0.0:1782487582.714196:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714219:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714255:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714273:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714292:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.714533:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+118:3316:x1869066299179520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5327us (5406us total) trans 8589939786 rc 0/0 00000100:00100000:0.0:1782487582.714548:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15514 00000100:00100000:0.0:1782487582.714573:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15520 00000100:00100000:0.0:1782487582.714589:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+107:3317:x1869066299180416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.714636:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6043 count 1 00010000:00010000:0.0:1782487582.714654:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714669:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b84ba15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472db9 expref: 107 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714681:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.714684:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.714688:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714712:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b84ba15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472db9 expref: 107 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.714723:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b84ba15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472db9 expref: 107 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.714736:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299181440:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.714841:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.714885:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299181056 00000100:00100000:0.0:1782487582.714892:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299181056 00000100:00100000:0.0:1782487582.714929:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15522 00000100:00100000:0.0:1782487582.714947:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+107:3316:x1869066299180288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.714966:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6042 count 1 00010000:00010000:0.0:1782487582.714984:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715012:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f122a728/0x66475b4e8b84b9eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472d9d expref: 108 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715035:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.715045:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.715056:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715094:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f122a728/0x66475b4e8b84b9eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d9d expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715122:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f122a728/0x66475b4e8b84b9eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d9d expref: 107 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.715155:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299181696:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.715194:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.715210:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.715217:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8529ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715256:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.715264:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8529ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715280:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8529ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715302:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8529ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715328:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8529ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x176f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715351:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.715360:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715385:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.715457:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715480:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715508:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715518:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b8529c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715542:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.715546:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.715550:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.715565:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715590:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715670:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715686:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005db02a7a/0x66475b4e8b8529c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.715712:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.716001:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+120:3315:x1869066299179008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7267us (7488us total) trans 8589939787 rc 0/0 00000100:00100000:0.0:1782487582.716011:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15513 00000100:00100000:0.0:1782487582.716037:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15526 00000100:00100000:0.0:1782487582.716048:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+119:3315:x1869066299180544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.716065:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5995 count 1 00010000:00010000:0.0:1782487582.716077:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716095:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b84b48f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472c38 expref: 108 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716109:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x176b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487582.716114:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x176b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.716121:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716153:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b84b48f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c38 expref: 108 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716179:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b84b48f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c38 expref: 108 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.716206:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299182336:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.716246:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff836c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.716262:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.716271:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b8529ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716299:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfe000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.716305:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b8529ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716319:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b8529ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716342:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b8529ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716371:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcc23da8/0x66475b4e8b8529ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716461:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.716466:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.716471:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.716485:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.716603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487582.716642:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716649:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716656:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716662:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.716665:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716669:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716680:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa6d:0x0].0x0 (ffff9cb4e6ebcd00) 00010000:00010000:0.0:1782487582.716683:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.716687:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716694:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852a00 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716734:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af32c560/0x66475b4e8b84b3fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c00 expref: 139 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.716801:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299179136:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.716822:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716872:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716899:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716920:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716933:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8529b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.716945:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.717132:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+109:3316:x1869066299178496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8794us (9126us total) trans 8589940476 rc 0/0 00000100:00100000:0.0:1782487582.717144:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15511 00010000:00010000:0.0:1782487582.717171:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.717177:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b8529cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717188:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.717299:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b8529cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717317:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b8529cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717331:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b8529cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717338:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378ce2ff/0x66475b4e8b8529cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717352:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.717356:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.717360:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.717439:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299183360 00000100:00100000:0.0:1782487582.717444:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299183360 00000100:00100000:0.0:1782487582.717479:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15532 00000100:00100000:0.0:1782487582.717488:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+110:3315:x1869066299183360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.717499:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6046 count 1 00010000:00010000:0.0:1782487582.717510:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b852a85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717520:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1dc3cc0/0x66475b4e8b84bf2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472f56 expref: 138 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717526:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.717528:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.717531:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b852a85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717547:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1dc3cc0/0x66475b4e8b84bf2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f56 expref: 138 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717556:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1dc3cc0/0x66475b4e8b84bf2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f56 expref: 138 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.717565:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299183616:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.717589:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83540 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.717602:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.717809:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8529a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717816:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35eda00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.717818:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8529a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717825:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8529a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717833:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8529a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717837:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bc87d6/0x66475b4e8b8529a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.717854:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.717857:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.717860:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.719354:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15533 00000100:00100000:0.0:1782487582.719364:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+112:3317:x1869066299184000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.719380:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6047 count 1 00010000:00010000:0.0:1782487582.719402:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719420:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b84bf08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a472f33 expref: 138 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719438:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b84c399 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4730a6 expref: 107 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719447:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.719454:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.719459:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719478:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b84c399 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4730a6 expref: 107 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719485:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b84c399 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4730a6 expref: 107 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.719494:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299184128:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.719531:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b84bf08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f33 expref: 138 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.719540:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b84bf08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f33 expref: 138 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.719548:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299184384:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.719566:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.719754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.719980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.720040:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299181440:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.720058:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.720081:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5967 00000100:00100000:0.0:1782487582.720091:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+139:2362:x1869066293838720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.720099:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.720105:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b84b4a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c54 expref: 139 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.720125:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b84b4a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c54 expref: 139 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.720156:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b84b4a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c54 expref: 139 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.720204:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.720209:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.720214:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b852a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.720223:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b852a07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.720251:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.720279:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2362:x1869066293838720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 188us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.720292:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5967 00000100:00100000:0.0:1782487582.720322:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299181696:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.720334:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.724732:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299182336:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.724770:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724883:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724896:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724906:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724921:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.724927:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724946:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724965:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb57fd34100) 00010000:00010000:0.0:1782487582.724970:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.724975:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.724981:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b852a2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725031:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299183616:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.725051:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b852a85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x179e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725091:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299184128:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.725136:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293839872 00000100:00100000:0.0:1782487582.725143:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293839872 00010000:00010000:0.0:1782487582.725173:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b84bbab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1775:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e37 expref: 114 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725228:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293840512 00000100:00100000:0.0:1782487582.725241:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293840512 00010000:00010000:0.0:1782487582.725260:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061b59b76/0x66475b4e8b84bbb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x179c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e3e expref: 109 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725299:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293840128 00000100:00100000:0.0:1782487582.725312:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293840128 00010000:00010000:0.0:1782487582.725331:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009afe8f92/0x66475b4e8b84bb18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e14 expref: 110 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725357:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293839104 00000100:00100000:0.0:1782487582.725362:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293839104 00010000:00010000:0.0:1782487582.725383:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f122a728/0x66475b4e8b84b9eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d9d expref: 111 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725426:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293839360 00000100:00100000:0.0:1782487582.725432:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293839360 00010000:00010000:0.0:1782487582.725453:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005aa69fbb/0x66475b4e8b84b4ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x176c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c69 expref: 109 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725490:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293839616 00000100:00100000:0.0:1782487582.725495:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293839616 00010000:00010000:0.0:1782487582.725514:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b84b48f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x176b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c38 expref: 110 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725530:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293840000 00000100:00100000:0.0:1782487582.725535:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293840000 00010000:00010000:0.0:1782487582.725554:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b84bbb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e45 expref: 114 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725587:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293841024 00000100:00100000:0.0:1782487582.725590:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293841024 00010000:00010000:0.0:1782487582.725624:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85241f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c8a expref: 118 pid: 190296 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725650:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5970 00000100:00100000:0.0:1782487582.725663:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2362:x1869066293840512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.725675:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.725682:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061b59b76/0x66475b4e8b84bbb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e3e expref: 112 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.725706:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061b59b76/0x66475b4e8b84bbb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e3e expref: 112 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.725734:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.725753:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x179c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.725765:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.725790:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.725813:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.725843:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2362:x1869066293840512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 182us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.725854:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5970 00000100:00100000:0.0:1782487582.725876:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293840640 00000100:00100000:0.0:1782487582.725882:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293840640 00010000:00010000:0.0:1782487582.725904:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b84bbce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1777:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472e4c expref: 116 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.725939:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293841536 00000100:00100000:0.0:1782487582.725944:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293841536 00010000:00010000:0.0:1782487582.725966:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b84bf08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f33 expref: 138 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.726003:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5975 00000100:00100000:0.0:1782487582.726017:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2361:x1869066293839360:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.726034:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.726045:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005aa69fbb/0x66475b4e8b84b4ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x176c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c69 expref: 111 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726064:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005aa69fbb/0x66475b4e8b84b4ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x176c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c69 expref: 111 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726089:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aa69fbb/0x66475b4e8b84b4ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x176c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472c69 expref: 112 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726106:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.726137:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2361:x1869066293839360:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 122us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.726157:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5975 00000100:00100000:0.0:1782487582.726187:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5978 00000100:00100000:0.0:1782487582.726204:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2361:x1869066293841024:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.726222:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.726246:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85241f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c8a expref: 118 pid: 190296 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726277:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85241f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c8a expref: 118 pid: 190296 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726314:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456342e00/0x66475b4e8b85241f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c8a expref: 118 pid: 190296 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726345:0:190282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa8:0x0].0x0 (ffff9cb5588ee300) 00010000:00010000:0.0:1782487582.726358:0:190282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726379:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726401:0:190282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726439:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.726468:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2361:x1869066293841024:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 266us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.726491:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5978 00000100:00100000:0.0:1782487582.726515:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5981 00000100:00100000:0.0:1782487582.726530:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2361:x1869066293839488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.726544:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.726554:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f25fcc4/0x66475b4e8b84b88d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d0a expref: 114 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726585:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f25fcc4/0x66475b4e8b84b88d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d0a expref: 114 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726649:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f25fcc4/0x66475b4e8b84b88d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1773:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472d0a expref: 114 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726682:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.726693:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.726704:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726724:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726803:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.726836:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2361:x1869066293839488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 308us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.726856:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5981 00000100:00100000:0.0:1782487582.726897:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5986 00000100:00100000:0.0:1782487582.726909:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2360:x1869066293841664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.726919:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.726927:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004610baaf/0x66475b4e8b84bf24 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x177a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f4f expref: 106 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726945:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004610baaf/0x66475b4e8b84bf24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x177a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f4f expref: 106 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.726977:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.726983:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.726994:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea7b5336/0x66475b4e8b852ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727021:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7b5336/0x66475b4e8b852ac4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x177a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727057:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.727082:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb449acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066293841664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 174us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.727099:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5986 00010000:00010000:0.0:1782487582.727141:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727168:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727199:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727212:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed30383f/0x66475b4e8b852a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.727223:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1782487582.727409:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+115:3316:x1869066299180288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12468us (13313us total) trans 8589940482 rc 0/0 00000100:00100000:0.0:1782487582.728285:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15522 00010000:00010000:0.0:1782487582.728323:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782487582.728332:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728349:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.728355:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728379:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728399:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728406:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x179c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728426:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782487582.728430:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b852abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728437:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ede00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.728441:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b852abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728454:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b852abd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728472:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b852abd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728532:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da07421/0x66475b4e8b852abd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728561:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782487582.728659:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6475060/0x66475b4e8b852a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728683:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffe00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.728691:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6475060/0x66475b4e8b852a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728728:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6475060/0x66475b4e8b852a62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728805:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6475060/0x66475b4e8b852a62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728814:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6475060/0x66475b4e8b852a62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728829:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.728831:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.728833:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.728850:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728869:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728885:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728891:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afffde9e/0x66475b4e8b852a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.728904:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.729044:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+115:3317:x1869066299180416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14460us (15020us total) trans 8589940484 rc 0/0 00000100:00100000:0.0:1782487582.729050:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15520 00010000:00010000:0.0:1782487582.729070:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729077:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729081:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729086:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b852a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729095:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.729285:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+122:3316:x1869066299180800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14193us (15132us total) trans 8589939792 rc 0/0 00000100:00100000:0.0:1782487582.729295:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15523 00010000:00010000:0.0:1782487582.729347:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b84bf08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a472f33 expref: 134 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.729358:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299184384:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.729378:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729389:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729393:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729398:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729403:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b852ab6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729425:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.729653:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+115:3317:x1869066299184000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10292us (11335us total) trans 8589940486 rc 0/0 00000100:00100000:0.0:1782487582.729658:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15533 00010000:00010000:0.0:1782487582.729673:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729680:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729686:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729695:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729706:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.729937:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb575f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+122:3315:x1869066299180544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13892us (15569us total) trans 8589939793 rc 0/0 00000100:00100000:0.0:1782487582.729943:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15526 00010000:00010000:0.0:1782487582.729962:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.729967:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729979:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.729985:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.729997:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730021:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730029:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b852a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x176b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730044:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.730048:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b852a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730053:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.730056:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b852a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x179d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730062:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b852a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x179d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730071:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b852a70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x179d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730076:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a7ce06f/0x66475b4e8b852a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x179d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730090:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.730092:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc30e/0x66475b4e8b852a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730097:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35eca00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.730099:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc30e/0x66475b4e8b852a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730104:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc30e/0x66475b4e8b852a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730113:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc30e/0x66475b4e8b852a5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730118:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc4dc30e/0x66475b4e8b852a5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730128:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.730132:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.730135:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782487582.730728:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770c000/2, rc 0, transno 8589940482 00000100:00100000:0.0:1782487582.730800:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299180288:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.730816:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44b4d1c00/2, rc 0, transno 8589939792 00000100:00100000:0.0:1782487582.730823:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299180800:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.730844:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a4700/2, rc 0, transno 8589940481 00000100:00100000:0.0:1782487582.730847:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299183872:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.730856:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a6300/2, rc 0, transno 8589940486 00000100:00100000:0.0:1782487582.730862:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299184000:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.730871:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb49058ed80/2, rc 0, transno 8589940487 00000100:00100000:0.0:1782487582.730875:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb49058ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299182848:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.730883:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546d9a680/2, rc 0, transno 8589939791 00000100:00100000:0.0:1782487582.730886:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299182720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.730891:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770f800/2, rc 0, transno 8589940484 00000100:00100000:0.0:1782487582.730894:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299180416:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487582.730908:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730914:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730920:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852a3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730925:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.730932:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.731076:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+122:3317:x1869066299180928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15767us (16875us total) trans 8589939796 rc 0/0 00000100:00100000:0.0:1782487582.731085:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15524 00000100:00100000:0.0:1782487582.731178:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299185408 00000100:00100000:0.0:1782487582.731194:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299185408 00000100:00100000:0.0:1782487582.731279:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299185920 00000100:00100000:0.0:1782487582.731282:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299185920 00000100:00100000:0.0:1782487582.731309:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299185280 00000100:00100000:0.0:1782487582.731313:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299185280 00000100:00100000:0.0:1782487582.731330:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299185792 00000100:00100000:0.0:1782487582.731333:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299185792 00000100:00100000:0.0:1782487582.731354:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15538 00000100:00100000:0.0:1782487582.731366:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+116:3317:x1869066299185408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.731387:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6053 count 1 00010000:00010000:0.0:1782487582.731399:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.731414:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6d02d09/0x66475b4e8b84c639 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47314e expref: 133 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.731438:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.731444:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.731447:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.731528:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6d02d09/0x66475b4e8b84c639 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47314e expref: 133 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.731554:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6d02d09/0x66475b4e8b84c639 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47314e expref: 133 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.731573:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299186304:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.731625:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.731645:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4526a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299185664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.731683:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.731701:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299186176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.731721:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.731917:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a7b80/2, rc 0, transno 8589940483 00000100:00100000:0.0:1782487582.731928:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299184768:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.731942:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a4e00/2, rc 0, transno 8589939790 00000100:00100000:0.0:1782487582.731952:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299184512:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.731963:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a7800/2, rc 0, transno 8589940485 00000100:00100000:0.0:1782487582.731970:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299183360:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.731985:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a5c00/2, rc 0, transno 8589940480 00000100:00100000:0.0:1782487582.731990:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299183232:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1782487582.732004:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4892f8000/2, rc 0, transno 8589939797 00000100:00100000:0.0:1782487582.732010:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4892f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299181056:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.732024:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546d9b480/2, rc 0, transno 8589939794 00000100:00100000:0.0:1782487582.732028:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299181568:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.732040:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44b4d1180/2, rc 0, transno 8589939793 00000100:00100000:0.0:1782487582.732047:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299180544:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.732056:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44b4d0e00/2, rc 0, transno 8589939795 00000100:00100000:0.0:1782487582.732061:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299180672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.732078:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299187456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.732110:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.732135:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487582.732143:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb579759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299187328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.732198:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299185536 00000100:00100000:0.0:1782487582.732203:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299185536 00000100:00100000:0.0:1782487582.732240:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299186048 00000100:00100000:0.0:1782487582.732243:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299186048 00000100:00100000:0.0:1782487582.732259:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299187456 00000100:00100000:0.0:1782487582.732262:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299187456 00000100:00100000:0.0:1782487582.732280:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299187072 00000100:00100000:0.0:1782487582.732283:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299187072 00000100:00100000:0.0:1782487582.732301:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299187200 00000100:00100000:0.0:1782487582.732305:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299187200 00000100:00100000:0.0:1782487582.732332:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15543 00000100:00100000:0.0:1782487582.732339:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+119:3314:x1869066299185536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.732350:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6050 count 1 00010000:00010000:0.0:1782487582.732364:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732377:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 133 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732383:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.732387:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.732392:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732417:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 133 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732430:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 133 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.732444:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb575e0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299188096:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.732470:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.732679:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15548 00000100:00100000:0.0:1782487582.732688:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+128:3316:x1869066299187200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.732700:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6016 count 1 00010000:00010000:0.0:1782487582.732710:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732726:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2fbc015/0x66475b4e8b84c3df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4730ad expref: 109 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732736:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1780:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.732801:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.732810:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732835:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2fbc015/0x66475b4e8b84c3df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4730ad expref: 109 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732844:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2fbc015/0x66475b4e8b84c3df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4730ad expref: 109 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.732860:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299188864:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.732883:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.732905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.732928:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299187328 00000100:00100000:0.0:1782487582.732933:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299187328 00000100:00100000:0.0:1782487582.732953:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15552 00000100:00100000:0.0:1782487582.732963:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+129:3315:x1869066299187328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.732976:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6012 count 1 00010000:00010000:0.0:1782487582.732988:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.732998:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 104 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.733004:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.733006:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.733008:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.733022:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 104 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.733029:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 104 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.733037:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299189248:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.733057:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1782487582.734305:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17f6:0x0], index 0: 0 00010000:00010000:0.0:1782487582.734444:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b852b73 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734454:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b852b73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734461:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b852b73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734504:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734510:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734515:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734519:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.734523:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734527:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734536:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.734538:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.734541:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734545:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b852af5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.734554:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000207ed42f reply state 00000000d7e4e1b3 transno 8589955738 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.734559:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.734590:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852aee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d8d expref: 530 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734618:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71400/0x66475b4e8b852b73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d8d expref: 529 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.734623:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa70:0x0].0x0 (ffff9cb46f434700) 00010000:00010000:0.0:1782487582.734626:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.734628:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71400, rc 0) 00000100:00100000:0.0:1782487582.734685:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+530:293441:x1869066293842560:12345-192.168.202.21@tcp:101:touch.500 Request processed in 4059us (4560us total) trans 8589955738 rc 0/0 00000100:00100000:0.0:1782487582.734693:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25506 00010000:00010000:0.0:1782487582.736074:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736084:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736091:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736098:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.736104:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736114:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736127:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa8:0x0].0x0 (ffff9cb5588ee300) 00010000:00010000:0.0:1782487582.736131:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.736136:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.736150:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7c00/0x66475b4e8b852a93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739731:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739740:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739757:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739766:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.739771:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739778:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739792:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb57fd34f00) 00010000:00010000:0.0:1782487582.739799:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.739805:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.739816:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b852afc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.739876:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb45a60aa00/2, rc 0, transno 8589939798 00000100:00100000:0.0:1782487582.739891:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299187456:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.739907:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4526a6d80/2, rc 0, transno 8589940489 00000100:00100000:0.0:1782487582.739917:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4526a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299185664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.740010:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487582.740022:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299189888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.740060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.740107:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb575e0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299188096:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.740129:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740176:0:213222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6d02d09/0x66475b4e8b84c639 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47314e expref: 130 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.740194:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299186304:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.740212:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740242:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740256:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740279:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740303:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740328:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.740527:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+124:3317:x1869066299185408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9162us (9451us total) trans 8589940491 rc 0/0 00000100:00100000:0.0:1782487582.740545:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15538 00010000:00010000:0.0:1782487582.740665:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.740674:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740685:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.740690:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740706:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740729:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740747:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b7e5b0e/0x66475b4e8b852b03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.740775:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.740779:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.740782:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.740972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.741058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.741080:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293843968 00000100:00100000:0.0:1782487582.741086:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293843968 00010000:00010000:0.0:1782487582.741109:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 130 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.741155:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5997 00000100:00100000:0.0:1782487582.741171:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+130:2360:x1869066293843968:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.741183:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.741189:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 130 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741203:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 130 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741636:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b70cbf67/0x66475b4e8b84c632 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47315c expref: 130 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741654:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.741659:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.741666:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741681:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741728:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.741752:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066293843968:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 584us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.741768:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5997 00000100:00100000:0.0:1782487582.741807:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293844736 00000100:00100000:0.0:1782487582.741812:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293844736 00010000:00010000:0.0:1782487582.741829:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f397184f/0x66475b4e8b84c82a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4731f6 expref: 129 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.741857:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6000 00000100:00100000:0.0:1782487582.741872:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066293844480:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.741884:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.741894:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000529c6a6d/0x66475b4e8b84c7cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4731cc expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741912:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000529c6a6d/0x66475b4e8b84c7cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4731cc expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741938:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529c6a6d/0x66475b4e8b84c7cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1781:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4731cc expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741970:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.741974:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.741979:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.741995:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742034:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.742059:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066293844480:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 188us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.742082:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6000 00000100:00100000:0.0:1782487582.742118:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6003 00000100:00100000:0.0:1782487582.742133:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2363:x1869066293844864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.742147:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.742157:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 101 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742359:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 101 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742377:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.742386:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.742397:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742414:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742471:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.742493:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2363:x1869066293844864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 363us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.742504:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6003 00010000:00010000:0.0:1782487582.742589:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.742593:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742599:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025b600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.742602:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742621:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742630:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852b6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742635:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x177e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742651:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.742654:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742661:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfe400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.742664:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742668:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852b2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742676:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852b2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742681:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852b2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742695:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.742700:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e23f7d11/0x66475b4e8b852b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742717:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.742723:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23f7d11/0x66475b4e8b852b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742741:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23f7d11/0x66475b4e8b852b5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742769:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e23f7d11/0x66475b4e8b852b5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742788:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e23f7d11/0x66475b4e8b852b5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742802:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.742806:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.742810:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742821:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.742825:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742833:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742844:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742852:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b852b42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742871:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.742873:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.742876:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.742901:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2fbc015/0x66475b4e8b84c3df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1780:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4730ad expref: 106 pid: 190930 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.742925:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299188864:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.742942:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742957:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742968:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.742985:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743014:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b852b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743043:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.743216:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+132:3316:x1869066299187200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10526us (10936us total) trans 8589939803 rc 0/0 00000100:00100000:0.0:1782487582.743227:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15548 00010000:00010000:0.0:1782487582.743279:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b84c62b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x177c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473155 expref: 100 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.743303:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299189248:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.743321:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743332:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743339:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743349:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743359:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743370:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.743518:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+131:3315:x1869066299187328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10555us (10614us total) trans 8589939805 rc 0/0 00000100:00100000:0.0:1782487582.743529:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15552 00010000:00010000:0.0:1782487582.743547:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487582.743552:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743562:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35eda00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.743566:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743600:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x177f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743638:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852b3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x177f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743658:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852b3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x177f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743687:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.743693:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743705:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.743713:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743734:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743746:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743754:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b852b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x177c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743783:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.743786:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.743788:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.743798:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743810:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743819:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743825:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b852b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.743840:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.743944:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+126:3314:x1869066299185536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11605us (11995us total) trans 8589940495 rc 0/0 00000100:00100000:0.0:1782487582.743953:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15543 00000100:00100000:0.0:1782487582.744029:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.744056:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.744088:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb579759c00/2, rc 0, transno 8589939805 00000100:00100000:0.0:1782487582.744098:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb579759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299187328:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.744109:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546d98e00/2, rc 0, transno 8589939801 00000100:00100000:0.0:1782487582.744111:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299186176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.744120:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487582.744127:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299190912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.744160:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.744269:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.744301:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.744324:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487582.744336:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.744371:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.744404:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.744410:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b852b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744419:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.744425:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b852b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744435:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b852b57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744452:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b852b57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744462:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b852b57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744486:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.744491:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.744495:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.744512:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15562 00000100:00100000:0.0:1782487582.744525:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+137:3316:x1869066299191168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.744545:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6021 count 1 00010000:00010000:0.0:1782487582.744562:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744582:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 105 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744631:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1785:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.744640:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.744646:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744675:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 105 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744693:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 105 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.744712:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299192064:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.744747:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff836c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.744787:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744817:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744831:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744837:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.744841:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744849:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744864:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb57fd34c00) 00010000:00010000:0.0:1782487582.744869:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.744874:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.744889:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d000/0x66475b4e8b852ad9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.744928:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299192704 00000100:00100000:0.0:1782487582.744934:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299192704 00000100:00100000:0.0:1782487582.744961:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15566 00000100:00100000:0.0:1782487582.744972:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+137:3315:x1869066299191424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.744993:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6023 count 1 00010000:00010000:0.0:1782487582.745008:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b852bff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745033:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b84cf00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4733e7 expref: 105 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745049:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1787:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.745058:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.745066:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b852bff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745095:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b84cf00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733e7 expref: 105 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745119:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b84cf00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733e7 expref: 105 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.745151:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299192960:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.745190:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.745209:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745222:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745230:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745250:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.745258:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745266:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745280:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa3:0x0].0x0 (ffff9cb46f434f00) 00010000:00010000:0.0:1782487582.745285:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.745289:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745297:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7200/0x66475b4e8b852ae7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745336:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745355:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745370:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745382:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025ae00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.745389:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745408:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745427:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa70:0x0].0x0 (ffff9cb57fd34900) 00010000:00010000:0.0:1782487582.745434:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.745441:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.745454:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025ae00/0x66475b4e8b852bb2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.746029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746251:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.746278:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293846656 00000100:00100000:0.0:1782487582.746284:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293846656 00010000:00010000:0.0:1782487582.746306:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b84ce66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733b6 expref: 105 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.746354:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6006 00000100:00100000:0.0:1782487582.746367:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2363:x1869066293846144:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.746378:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.746387:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7d741f5/0x66475b4e8b84cc4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473307 expref: 105 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.746414:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7d741f5/0x66475b4e8b84cc4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473307 expref: 105 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.746445:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d741f5/0x66475b4e8b84cc4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473307 expref: 105 pid: 213224 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.746475:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.746485:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.746495:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b852b96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.746523:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b852b96 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.746556:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.746585:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2363:x1869066293846144:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.746601:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6006 00000100:00100000:0.0:1782487582.747033:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299193600 00000100:00100000:0.0:1782487582.747038:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299193600 00000100:00100000:0.0:1782487582.747077:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15571 00000100:00100000:0.0:1782487582.747087:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+131:3316:x1869066299193600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.747102:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6065 count 1 00010000:00010000:0.0:1782487582.747117:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747132:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b84d33d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473529 expref: 126 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747147:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b1:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.747155:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.747165:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747191:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b84d33d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473529 expref: 126 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747223:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b84d33d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473529 expref: 126 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.747272:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299193728:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.747322:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000004:00080000:0.0:1782487582.747355:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54765ca80/2, rc 0, transno 8589940498 00000100:00100000:0.0:1782487582.747369:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299189888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.747728:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299193856 00000100:00100000:0.0:1782487582.747734:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299193856 00000100:00100000:0.0:1782487582.747771:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299193984 00000100:00100000:0.0:1782487582.747776:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299193984 00000100:00100000:0.0:1782487582.747804:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15573 00000100:00100000:0.0:1782487582.747819:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+132:3314:x1869066299193984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.747834:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6072 count 1 00010000:00010000:0.0:1782487582.747853:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747880:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 126 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747899:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b8:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.747908:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.747918:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747963:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 126 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.747990:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 126 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.748012:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299194240:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.748056:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.750093:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299192064:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.750113:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750227:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299192960:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.750316:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b852bff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750385:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293847552 00000100:00100000:0.0:1782487582.750391:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293847552 00010000:00010000:0.0:1782487582.750414:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e3cff8f/0x66475b4e8b84caa7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47325f expref: 106 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750462:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293847808 00000100:00100000:0.0:1782487582.750467:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293847808 00010000:00010000:0.0:1782487582.750486:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000678c4d55/0x66475b4e8b84c66a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x177d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473171 expref: 100 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750507:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848192 00000100:00100000:0.0:1782487582.750510:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848192 00010000:00010000:0.0:1782487582.750527:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b84ce89 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733bd expref: 107 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750553:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848576 00000100:00100000:0.0:1782487582.750559:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848576 00010000:00010000:0.0:1782487582.750586:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b84cf00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1787:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733e7 expref: 108 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750603:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848832 00000100:00100000:0.0:1782487582.750650:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848832 00010000:00010000:0.0:1782487582.750669:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004af30b16/0x66475b4e8b84d36e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473553 expref: 127 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750690:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293849088 00000100:00100000:0.0:1782487582.750697:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293849088 00010000:00010000:0.0:1782487582.750718:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b84cbd4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732b3 expref: 128 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750738:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293849344 00000100:00100000:0.0:1782487582.750743:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293849344 00010000:00010000:0.0:1782487582.750759:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7ae589/0x66475b4e8b84c65c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x177b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473163 expref: 101 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750782:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293847680 00000100:00100000:0.0:1782487582.750786:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293847680 00010000:00010000:0.0:1782487582.750806:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b84cbc6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1783:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732ac expref: 102 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750828:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293847936 00000100:00100000:0.0:1782487582.750834:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293847936 00010000:00010000:0.0:1782487582.750855:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 109 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750870:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848320 00000100:00100000:0.0:1782487582.750875:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848320 00010000:00010000:0.0:1782487582.750892:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3281c66/0x66475b4e8b84cfcb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1788:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47340a expref: 110 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750908:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848704 00000100:00100000:0.0:1782487582.750911:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848704 00010000:00010000:0.0:1782487582.750923:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e98712b/0x66475b4e8b84d328 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473522 expref: 129 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750957:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293848960 00000100:00100000:0.0:1782487582.750961:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293848960 00010000:00010000:0.0:1782487582.750975:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b84d018 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473457 expref: 100 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.750999:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293849216 00000100:00100000:0.0:1782487582.751003:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293849216 00010000:00010000:0.0:1782487582.751017:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006282955a/0x66475b4e8b84cfc4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473403 expref: 101 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.751036:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6009 00000100:00100000:0.0:1782487582.751046:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2362:x1869066293847552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.751056:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.751063:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e3cff8f/0x66475b4e8b84caa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47325f expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751088:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e3cff8f/0x66475b4e8b84caa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47325f expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751111:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e3cff8f/0x66475b4e8b84caa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1784:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47325f expref: 110 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751139:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.751145:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.751156:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b852bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751178:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b852bd5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751213:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.751260:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2362:x1869066293847552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 214us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.751277:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6009 00000100:00100000:0.0:1782487582.751300:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6011 00000100:00100000:0.0:1782487582.751310:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2362:x1869066293848192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.751322:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.751331:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b84ce89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733bd expref: 108 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751345:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b84ce89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733bd expref: 108 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751366:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b84ce89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1786:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4733bd expref: 108 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751386:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.751392:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.751402:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b852bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751413:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b852bf1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1786:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.751449:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.751475:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2362:x1869066293848192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.751491:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6011 00000100:00100000:0.0:1782487582.752588:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6013 00000004:00080000:0.0:1782487582.752631:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54765f100/2, rc 0, transno 8589939806 00000100:00100000:0.0:1782487582.752643:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299190912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.752674:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6015 00000100:00100000:0.0:1782487582.752690:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2362:x1869066293849344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.752705:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.752721:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce7ae589/0x66475b4e8b84c65c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x177b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473163 expref: 100 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.752745:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce7ae589/0x66475b4e8b84c65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x177b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473163 expref: 100 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.752767:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.752775:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x177b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.752784:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b852b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x177b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.752804:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b852b8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x177b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.752836:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.752872:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e083b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2362:x1869066293849344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 188us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.752888:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6015 00000100:00100000:0.0:1782487582.752919:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6017 00000100:00100000:0.0:1782487582.752930:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2362:x1869066293847936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.752942:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.752952:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 104 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.752978:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 104 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753000:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b84cc75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1785:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4732f9 expref: 104 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753023:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.753027:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.753032:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753054:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753101:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.753127:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2362:x1869066293847936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 199us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.753143:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6017 00000100:00100000:0.0:1782487582.753161:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6019 00000100:00100000:0.0:1782487582.753168:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2362:x1869066293848704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.753177:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.753187:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e98712b/0x66475b4e8b84d328 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473522 expref: 127 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753204:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e98712b/0x66475b4e8b84d328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473522 expref: 127 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753252:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e98712b/0x66475b4e8b84d328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473522 expref: 127 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753266:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.753273:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.753283:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753299:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753349:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.753377:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2362:x1869066293848704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 208us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.753393:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6019 00010000:00010000:0.0:1782487582.753430:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753458:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753486:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753512:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e09e2a4a/0x66475b4e8b852c06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753531:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.753753:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+133:3314:x1869066299192576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8700us (8900us total) trans 8589940501 rc 0/0 00000100:00100000:0.0:1782487582.753764:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15567 00010000:00010000:0.0:1782487582.753857:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753874:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753896:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753908:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.753913:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753922:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753936:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb57fd34f00) 00010000:00010000:0.0:1782487582.753941:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.753948:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.753956:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92d200/0x66475b4e8b852c29 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.753994:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2362:x1869066293848832:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.754008:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.754019:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004af30b16/0x66475b4e8b84d36e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473553 expref: 125 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754039:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004af30b16/0x66475b4e8b84d36e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473553 expref: 125 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754064:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004af30b16/0x66475b4e8b84d36e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473553 expref: 125 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754087:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754096:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754105:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852c0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754127:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b92d71/0x66475b4e8b852c0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.754166:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293849600 00000100:00100000:0.0:1782487582.754173:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293849600 00010000:00010000:0.0:1782487582.754195:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b84d33d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473529 expref: 127 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.754225:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6022 00000100:00100000:0.0:1782487582.754246:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2362:x1869066293849728:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.754260:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.754269:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b84d336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47353e expref: 127 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754285:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b84d336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47353e expref: 127 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754310:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b84d336 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47353e expref: 127 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754347:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754354:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754362:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b852c4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754386:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b852c4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754409:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.754436:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2362:x1869066293849728:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.754462:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6022 00000100:00100000:0.0:1782487582.754487:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6025 00000100:00100000:0.0:1782487582.754503:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2362:x1869066293849856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.754521:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.754530:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 125 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754548:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 125 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754572:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754581:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.754589:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754637:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754671:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.754701:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2362:x1869066293849856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.754716:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6025 00010000:00010000:0.0:1782487582.754766:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754779:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754793:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754809:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856c64a5/0x66475b4e8b852bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.754843:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.755020:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+139:3316:x1869066299191168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10499us (10935us total) trans 8589939812 rc 0/0 00000100:00100000:0.0:1782487582.755028:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15562 00000100:00100000:0.0:1782487582.755049:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15576 00000100:00100000:0.0:1782487582.755057:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066293850368:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.755067:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.755081:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474dda expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.755109:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17f4:0x0] initial LVB size: 0, mtime: 0x6a3e9a1f, atime: 0x6a3e9a1f, ctime: 0x6a3e9a1f, blocks: 0x1 00010000:00010000:0.0:1782487582.755121:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=7210s v=(0 0) 00010000:00010000:0.0:1782487582.755127:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.755137:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 100 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755151:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 100 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755161:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025ae00, rc 0) 00000100:00100000:0.0:1782487582.755184:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066293850368:12345-192.168.202.21@tcp:101:rm.500 Request processed in 130us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.755196:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15576 00000004:00080000:0.0:1782487582.755253:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847800/2, rc 0, transno 8589939811 00000100:00100000:0.0:1782487582.755261:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191552:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.755275:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb46eabc700/2, rc 0, transno 8589939810 00000100:00100000:0.0:1782487582.755284:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.755312:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b84d33d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473529 expref: 123 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.755329:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299193728:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.755344:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755354:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755362:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755377:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755391:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b852c37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755410:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.755555:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+133:3316:x1869066299193600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8470us (8544us total) trans 8589940504 rc 0/0 00000100:00100000:0.0:1782487582.755563:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15571 00000100:00100000:0.0:1782487582.755578:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293850624 00000100:00100000:0.0:1782487582.755582:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293850624 00000100:00100000:0.0:1782487582.755634:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15578 00000100:00100000:0.0:1782487582.755645:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066293850624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.755652:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.755664:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474de1 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.755697:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17ce:0x0] initial LVB size: 0, mtime: 0x6a3e9a1f, atime: 0x6a3e9a1f, ctime: 0x6a3e9a1f, blocks: 0x1 00010000:00010000:0.0:1782487582.755707:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=7210s v=(0 0) 00010000:00010000:0.0:1782487582.755711:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.755718:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 103 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755729:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 103 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.755737:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025b600, rc 0) 00000100:00100000:0.0:1782487582.755766:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066293850624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.755777:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15578 00010000:00010000:0.0:1782487582.755811:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.755839:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2362:x1869066293848832:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 3240us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.755854:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6013 00000100:00100000:0.0:1782487582.755895:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293850752 00000100:00100000:0.0:1782487582.755901:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293850752 00010000:00010000:0.0:1782487582.755922:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a692401/0x66475b4e8b84d321 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47351b expref: 97 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.755951:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6026 00000100:00100000:0.0:1782487582.755963:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2362:x1869066293850752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.755985:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.755993:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a692401/0x66475b4e8b84d321 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47351b expref: 97 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756020:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a692401/0x66475b4e8b84d321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47351b expref: 97 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756043:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.756049:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.756060:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756080:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a61e51/0x66475b4e8b852ced lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1789:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756108:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.756130:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2362:x1869066293850752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.756136:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6026 00010000:00010000:0.0:1782487582.756177:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3045a3b/0x66475b4e8b84e025 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473997 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.756199:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299194240:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.756215:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756256:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756279:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756308:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756332:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b852c53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756357:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.756498:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+133:3314:x1869066299193984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8681us (8761us total) trans 8589940508 rc 0/0 00000100:00100000:0.0:1782487582.756511:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15573 00000100:00100000:0.0:1782487582.756774:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299195136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487582.756832:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299194880 00000100:00100000:0.0:1782487582.756837:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299194880 00000100:00100000:0.0:1782487582.756870:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15579 00000100:00100000:0.0:1782487582.756882:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+133:3317:x1869066299194880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.756898:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6071 count 1 00010000:00010000:0.0:1782487582.756913:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756937:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004cbffa84/0x66475b4e8b84db6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4737d0 expref: 120 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756957:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fea2e602/0x66475b4e8b84db78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473808 expref: 120 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.756966:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b7:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.756970:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.756978:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757005:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fea2e602/0x66475b4e8b84db78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473808 expref: 120 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757027:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fea2e602/0x66475b4e8b84db78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473808 expref: 120 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.757045:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299195520:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.757113:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004cbffa84/0x66475b4e8b84db6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4737d0 expref: 120 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757129:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004cbffa84/0x66475b4e8b84db6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4737d0 expref: 120 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.757175:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299195648:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.757213:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.757230:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299195776 00000100:00100000:0.0:1782487582.757247:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299195776 00000100:00100000:0.0:1782487582.757275:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15581 00000100:00100000:0.0:1782487582.757283:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+138:3317:x1869066299194752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.757294:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6074 count 1 00010000:00010000:0.0:1782487582.757306:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757318:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 99 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757324:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ba:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.757328:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.757331:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757352:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 99 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757372:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 99 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.757413:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299196160:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.757532:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.757555:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299195904 00000100:00100000:0.0:1782487582.757560:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299195904 00000100:00100000:0.0:1782487582.757588:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15583 00000100:00100000:0.0:1782487582.757600:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+139:3314:x1869066299195008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.757663:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6075 count 1 00010000:00010000:0.0:1782487582.757678:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757694:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a52b2456/0x66475b4e8b84e159 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4739cf expref: 99 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757712:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bb:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.757717:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.757727:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757763:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a52b2456/0x66475b4e8b84e159 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739cf expref: 99 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.757775:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a52b2456/0x66475b4e8b84e159 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739cf expref: 99 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.757801:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299197312:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.757834:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.757855:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293850880 00000100:00100000:0.0:1782487582.757860:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293850880 00000100:00100000:0.0:1782487582.757886:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299196288 00000100:00100000:0.0:1782487582.757890:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299196288 00000100:00100000:0.0:1782487582.757907:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299196928 00000100:00100000:0.0:1782487582.757911:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299196928 00000100:00100000:0.0:1782487582.757927:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299196416 00000100:00100000:0.0:1782487582.757932:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299196416 00000100:00100000:0.0:1782487582.757952:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293851776 00000100:00100000:0.0:1782487582.757955:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293851776 00000100:00100000:0.0:1782487582.757973:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15584 00000100:00100000:0.0:1782487582.757982:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:3314:x1869066299195776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487582.757993:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6070 count 1 00010000:00010000:0.0:1782487582.758006:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758019:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 120 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758027:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b6:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.758032:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.758041:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758069:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 120 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758097:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 120 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.758121:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299197440:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.758164:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.758186:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15586 00000100:00100000:0.0:1782487582.758198:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066293850880:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487582.758207:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.758222:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474de8 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782487582.758250:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17f5:0x0] initial LVB size: 0, mtime: 0x6a3e9a1f, atime: 0x6a3e9a1f, ctime: 0x6a3e9a1f, blocks: 0x1 00010000:00010000:0.0:1782487582.758269:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=7210s v=(0 0) 00010000:00010000:0.0:1782487582.758278:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.758294:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 101 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758329:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 101 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758358:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7c00, rc 0) 00000100:00100000:0.0:1782487582.758385:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066293850880:12345-192.168.202.21@tcp:101:rm.500 Request processed in 189us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.758409:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15586 00000100:00100000:0.0:1782487582.758437:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15589 00000100:00100000:0.0:1782487582.758449:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+142:3316:x1869066299196416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.758467:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6026 count 1 00010000:00010000:0.0:1782487582.758483:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758511:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b84d32f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473530 expref: 95 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758535:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x178a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.758545:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x178a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.758550:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758576:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b84d32f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473530 expref: 95 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.758594:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b84d32f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473530 expref: 95 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.758639:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299197952:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.758672:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56ff836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.758723:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782487582.758757:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548846d80/2, rc 0, transno 8589939815 00000100:00100000:0.0:1782487582.758774:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299191424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.758793:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb49058f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299196800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.758837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.758857:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782487582.758869:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb49058d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299196544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.758905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.758925:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299197184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.758957:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.759024:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299198336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.759071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.759115:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15595 00000100:00100000:0.0:1782487582.759131:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+146:3315:x1869066299197184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.759150:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6033 count 1 00010000:00010000:0.0:1782487582.759165:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759184:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 95 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759201:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1791:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.759206:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.759212:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759258:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 95 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759284:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 95 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.759310:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299198720:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.759349:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.759966:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759975:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759982:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759987:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.759991:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.759998:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.760011:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa7:0x0].0x0 (ffff9cb548f15900) 00010000:00010000:0.0:1782487582.760014:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.760018:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.760024:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b852c5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.760922:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.760946:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852160 00000100:00100000:0.0:1782487582.760951:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852160 00000100:00100000:0.0:1782487582.760968:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210179588597 time 7210181606176 state 0x0 ref 1 00000100:00100000:0.0:1782487582.760978:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210181706176 time 7210181606176 state 0x1 ref 1 00000100:00100000:0.0:1782487582.761008:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210181706176 time 7210182397937 state 0x0 ref 1 00000100:00100000:0.0:1782487582.761019:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46e083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+114:293403:x1869066293852160:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.761112:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.761193:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852d17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474dd3 expref: 114 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761217:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b851c3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474b4f expref: 113 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761230:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa8:0x0].0x0 (ffff9cb5588ee300) 00010000:00010000:0.0:1782487582.761243:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.761257:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761268:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761276:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761295:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761303:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761312:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761411:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761421:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.761430:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.761969:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2417, 64 off162880 00010000:00010000:0.0:1782487582.762067:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762077:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762086:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762094:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762101:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762108:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138800/0x66475b4e8b852de2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762133:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.762149:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762156:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762164:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762179:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.762184:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762194:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762206:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa8:0x0].0x0 (ffff9cb5588ee300) 00010000:00010000:0.0:1782487582.762210:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.762213:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762220:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852ddb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xaa8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762243:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762267:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762284:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762291:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.762295:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762305:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762316:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.762319:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.762322:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.762329:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852dcd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.762341:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a530ef8e reply state 00000000ab48fa7f transno 8589955750 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.762348:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.762405:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+114:293403:x1869066293852160:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1387us (1484us total) trans 8589955750 rc 0/0 00000100:00100000:0.0:1782487582.762414:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25522 00000100:00100000:0.0:1782487582.762420:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210181706176 time 7210182397937 state 0x2 ref 0 00000100:00100000:0.0:1782487582.762490:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299196160:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.762509:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.762852:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299197312:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.762870:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.762933:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299197440:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.762948:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.763034:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299195520:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.763265:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299197952:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.763280:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.763402:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4cbabce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299195648:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.763424:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.764741:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e080700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299198720:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.764761:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765359:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852288 00000100:00100000:0.0:1782487582.765366:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852288 00010000:00010000:0.0:1782487582.765398:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b84de9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47392e expref: 121 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765429:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852672 00000100:00100000:0.0:1782487582.765435:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852672 00010000:00010000:0.0:1782487582.765455:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b84e009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47399e expref: 122 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765478:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852928 00000100:00100000:0.0:1782487582.765484:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852928 00010000:00010000:0.0:1782487582.765502:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 123 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765523:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293854080 00000100:00100000:0.0:1782487582.765527:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293854080 00010000:00010000:0.0:1782487582.765545:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b84d32f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x178a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473530 expref: 96 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765574:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6028 00000100:00100000:0.0:1782487582.765591:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2363:x1869066293852672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.765660:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.765670:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b84e009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47399e expref: 124 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765690:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b84e009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47399e expref: 124 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765708:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b84e009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47399e expref: 124 pid: 213222 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765722:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.765738:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.765745:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765757:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056731a0f/0x66475b4e8b852d33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765783:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.765809:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2363:x1869066293852672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.765826:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6028 00000100:00100000:0.0:1782487582.765846:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293854464 00000100:00100000:0.0:1782487582.765850:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293854464 00010000:00010000:0.0:1782487582.765867:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004cbffa84/0x66475b4e8b84db6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4737d0 expref: 122 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.765907:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6029 00000100:00100000:0.0:1782487582.765921:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2363:x1869066293852928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.765932:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.765942:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765958:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.765985:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f4deb66/0x66475b4e8b84e01e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739a5 expref: 121 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766008:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766014:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766024:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766040:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766078:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.766106:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2363:x1869066293852928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 188us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.766123:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6029 00000100:00100000:0.0:1782487582.766155:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852416 00000100:00100000:0.0:1782487582.766161:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852416 00010000:00010000:0.0:1782487582.766182:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 101 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.766245:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293852800 00000100:00100000:0.0:1782487582.766250:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293852800 00010000:00010000:0.0:1782487582.766267:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a52b2456/0x66475b4e8b84e159 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739cf expref: 102 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.766290:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293853056 00000100:00100000:0.0:1782487582.766295:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293853056 00010000:00010000:0.0:1782487582.766313:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b84e201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a0e expref: 103 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.766339:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293854336 00000100:00100000:0.0:1782487582.766344:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293854336 00010000:00010000:0.0:1782487582.766366:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7891217/0x66475b4e8b84df14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47393c expref: 118 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.766394:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6033 00000100:00100000:0.0:1782487582.766411:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+96:2363:x1869066293854976:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.766426:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.766435:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 96 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766462:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 96 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766488:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000467975c5/0x66475b4e8b84de7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1791:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473927 expref: 96 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766517:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766521:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766527:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766536:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766557:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.766585:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+95:2363:x1869066293854976:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.766599:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6033 00000100:00100000:0.0:1782487582.766639:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293854208 00000100:00100000:0.0:1782487582.766644:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293854208 00010000:00010000:0.0:1782487582.766663:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9e987e/0x66475b4e8b84db63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x178e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47378a expref: 96 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.766705:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6034 00000100:00100000:0.0:1782487582.766718:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2363:x1869066293852416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.766733:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.766746:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 103 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766777:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 103 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766808:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b84db5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47377c expref: 102 pid: 213228 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766838:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766845:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.766850:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766873:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.766910:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.766936:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2363:x1869066293852416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 220us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.766952:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6034 00000100:00100000:0.0:1782487582.766970:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293853824 00000100:00100000:0.0:1782487582.766975:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293853824 00010000:00010000:0.0:1782487582.766994:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002eeaa0bd/0x66475b4e8b84d9cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473705 expref: 106 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.767029:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6038 00000100:00100000:0.0:1782487582.767042:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2363:x1869066293854336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.767056:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.767065:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7891217/0x66475b4e8b84df14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47393c expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767086:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7891217/0x66475b4e8b84df14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47393c expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767111:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7891217/0x66475b4e8b84df14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47393c expref: 116 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767133:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.767143:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.767153:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7cae4c4/0x66475b4e8b852da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767173:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cae4c4/0x66475b4e8b852da3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767207:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.767397:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2363:x1869066293854336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 356us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.767410:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6038 00000100:00100000:0.0:1782487582.767434:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6041 00000100:00100000:0.0:1782487582.767446:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2361:x1869066293854848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.767458:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.767471:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0972255/0x66475b4e8b84e160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1794:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739dd expref: 106 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767518:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0972255/0x66475b4e8b84e160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1794:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739dd expref: 106 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767539:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0972255/0x66475b4e8b84e160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1794:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4739dd expref: 105 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767560:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.767570:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.767579:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852dbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767627:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852dbf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1794:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.767649:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293855488 00000100:00100000:0.0:1782487582.767656:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293855488 00000100:00100000:0.0:1782487582.767698:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1010 00000100:00100000:0.0:1782487582.767712:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2360:x1869066293855488:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.767740:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.767752:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852e13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e0b expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767783:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767817:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767837:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767849:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767867:0:213216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767883:0:213216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767904:0:213216:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767918:0:213216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767945:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767954:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767975:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.767993:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450139600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.767999:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768017:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768037:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487582.768041:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.768043:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768051:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768055:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768069:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768075:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852dd4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768091:0:213216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768098:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768145:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768162:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768175:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768189:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.768197:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768214:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768817:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.768824:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.768830:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768849:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138e00/0x66475b4e8b852e21 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768869:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768888:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768905:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768915:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.768922:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768950:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768964:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487582.768967:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.768971:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.768987:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019bc00/0x66475b4e8b852e2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.769027:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852e13 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e0b expref: 115 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770127:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.770131:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.770137:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852e13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e0b expref: 114 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770151:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb450138200, rc -2) 00000100:00100000:0.0:1782487582.770185:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066293855488:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2477us (2737us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.770193:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1010 00010000:00010000:0.0:1782487582.770220:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770228:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770251:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770258:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.770262:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770270:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770281:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4e6ebc000) 00010000:00010000:0.0:1782487582.770284:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.770287:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770295:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852df7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770325:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770335:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770344:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770352:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d32aa20/0x66475b4e8b852d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770372:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.770552:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+143:3314:x1869066299195008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12953us (13532us total) trans 8589940513 rc 0/0 00000100:00100000:0.0:1782487582.770564:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15583 00010000:00010000:0.0:1782487582.770595:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770776:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770789:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770797:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f378e80/0x66475b4e8b852d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.770814:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.770969:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+143:3317:x1869066299194752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13687us (14050us total) trans 8589940514 rc 0/0 00000100:00100000:0.0:1782487582.770976:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15581 00010000:00010000:0.0:1782487582.771007:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.771036:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066293854848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 3593us (4556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.772122:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6041 00010000:00010000:0.0:1782487582.772167:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772181:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772204:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772212:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c76ea3d0/0x66475b4e8b852d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772244:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.772434:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+143:3314:x1869066299195776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14451us (15271us total) trans 8589940515 rc 0/0 00000100:00100000:0.0:1782487582.772448:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15584 00000100:00100000:0.0:1782487582.772478:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293856640 00000100:00100000:0.0:1782487582.772482:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293856640 00010000:00010000:0.0:1782487582.772503:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000691fce43/0x66475b4e8b84e1f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1795:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a00 expref: 103 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.772522:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293856768 00000100:00100000:0.0:1782487582.772527:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293856768 00010000:00010000:0.0:1782487582.772544:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bf6a274/0x66475b4e8b84def1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473935 expref: 91 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.772568:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6047 00000100:00100000:0.0:1782487582.772579:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+91:2363:x1869066293856512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.772592:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.772602:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b84dfed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1793:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47397b expref: 91 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772639:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b84dfed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1793:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47397b expref: 91 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772660:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b84dfed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1793:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47397b expref: 91 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772681:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.772689:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.772698:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772715:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b852e59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1793:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772752:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.772779:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2363:x1869066293856512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.772796:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6047 00000100:00100000:0.0:1782487582.772822:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6048 00000100:00100000:0.0:1782487582.772831:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2362:x1869066293856640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.772840:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.772848:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000691fce43/0x66475b4e8b84e1f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1795:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a00 expref: 103 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772864:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000691fce43/0x66475b4e8b84e1f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1795:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a00 expref: 103 pid: 213213 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772877:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.772885:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.772894:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b852e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1795:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772908:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b852e4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1795:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.772939:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.772971:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2362:x1869066293856640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 139us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.772988:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6048 00010000:00010000:0.0:1782487582.773013:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773030:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773051:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773069:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.773077:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773098:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773125:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4e6ebc900) 00010000:00010000:0.0:1782487582.773129:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.773133:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773153:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b852e6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773196:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773218:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773245:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773266:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.773274:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773292:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773305:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaa5:0x0].0x0 (ffff9cb45539cc00) 00010000:00010000:0.0:1782487582.773312:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.773317:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773327:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff200/0x66475b4e8b852de9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.773383:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb46e082680/2, rc 0, transno 8589939822 00000100:00100000:0.0:1782487582.773400:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299198336:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.773423:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb49058d880/2, rc 0, transno 8589939819 00000100:00100000:0.0:1782487582.773431:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb49058d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299196544:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.773448:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb49058f100/2, rc 0, transno 8589939821 00000100:00100000:0.0:1782487582.773455:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb49058f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299196800:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.773469:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79180/2, rc 0, transno 8589940512 00000100:00100000:0.0:1782487582.773480:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299195136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487582.773503:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773513:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773520:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773524:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b852d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x178a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773542:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.773723:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+150:3316:x1869066299196416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15274us (15842us total) trans 8589939825 rc 0/0 00000100:00100000:0.0:1782487582.773735:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15589 00010000:00010000:0.0:1782487582.773768:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773780:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773789:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773797:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d74a8d28/0x66475b4e8b852d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.773809:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.773987:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+143:3317:x1869066299194880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17108us (17175us total) trans 8589940517 rc 0/0 00000100:00100000:0.0:1782487582.773995:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15579 00010000:00010000:0.0:1782487582.774111:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774133:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774149:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774168:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a7ce06f/0x66475b4e8b852db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774191:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.774336:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46e081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3315:x1869066299197184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15209us (15381us total) trans 8589939826 rc 0/0 00000100:00100000:0.0:1782487582.774351:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15595 00000100:00100000:0.0:1782487582.774365:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299200768 00000100:00100000:0.0:1782487582.774370:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299200768 00000100:00100000:0.0:1782487582.774395:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15603 00000100:00100000:0.0:1782487582.774406:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3316:x1869066299200768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.774427:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6040 count 1 00010000:00010000:0.0:1782487582.774440:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774467:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 101 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774478:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1798:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.774486:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.774494:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774525:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 101 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774544:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 101 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.774563:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299200896:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.774656:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00a80 going to sleep for 11 seconds 00000004:00080000:0.0:1782487582.774678:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491aca80/2, rc 0, transno 8589939826 00000100:00100000:0.0:1782487582.774685:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299197184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.774810:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb560a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299201536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.774847:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.774878:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299201536 00000100:00100000:0.0:1782487582.774883:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299201536 00000100:00100000:0.0:1782487582.774908:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15607 00000100:00100000:0.0:1782487582.774917:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+155:3317:x1869066299201280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.774929:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6041 count 1 00010000:00010000:0.0:1782487582.774944:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774966:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 101 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.774975:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1799:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487582.774979:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.774984:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775014:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 101 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775035:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 101 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.775056:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299201792:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.775095:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.775352:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299202048 00000100:00100000:0.0:1782487582.775357:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299202048 00000100:00100000:0.0:1782487582.775387:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15610 00000100:00100000:0.0:1782487582.775395:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+157:3316:x1869066299202048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.775407:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6044 count 1 00010000:00010000:0.0:1782487582.775416:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b852ed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775424:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 87 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775431:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018aba076/0x66475b4e8b84f1a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473f16 expref: 101 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775435:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.775437:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.775440:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b852ed0 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775454:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018aba076/0x66475b4e8b84f1a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f16 expref: 101 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775462:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018aba076/0x66475b4e8b84f1a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f16 expref: 101 pid: 190931 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.775470:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299202304:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.775499:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 87 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.775507:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 87 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.775515:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299202432:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.775534:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00900 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.777781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.777805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.777827:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293856896 00000100:00100000:0.0:1782487582.777831:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293856896 00000100:00100000:0.0:1782487582.777848:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210192227609 time 7210194351297 state 0x0 ref 1 00000100:00100000:0.0:1782487582.777858:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210194451297 time 7210194351297 state 0x1 ref 1 00000100:00100000:0.0:1782487582.777877:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293857152 00000100:00100000:0.0:1782487582.777879:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293857152 00000100:00100000:0.0:1782487582.777901:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210199379728 time 7210199279728 state 0x1 ref 2 00000100:00100000:0.0:1782487582.777915:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210199379728 time 7210199305378 state 0x0 ref 2 00000100:00100000:0.0:1782487582.777924:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+545:293453:x1869066293857152:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.777931:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.777944:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b852ede lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e4a expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778090:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778102:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778118:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778133:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778141:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778147:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778211:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8c00/0x66475b4e8b852ef3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778225:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8c00/0x66475b4e8b852ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778246:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8c00/0x66475b4e8b852ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487582.778258:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaaa:0x0]: returning size 0 00010000:00010000:0.0:1782487582.778331:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778349:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778354:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778368:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e8600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.778371:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778375:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778381:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.778382:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.778385:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778388:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b852ee5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778398:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778402:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778405:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778408:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.778410:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778414:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778417:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487582.778419:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.778420:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778423:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9c00/0x66475b4e8b852eec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778449:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b852ede lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e4a expref: 549 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778465:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8c00/0x66475b4e8b852ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e4a expref: 548 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778475:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaaa:0x0].0x0 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.778477:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.778479:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e8c00, rc 0) 00000100:00100000:0.0:1782487582.778504:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+549:293453:x1869066293857152:12345-192.168.202.21@tcp:101:touch.500 Request processed in 582us (698us total) trans 8589955756 rc 0/0 00000100:00100000:0.0:1782487582.778508:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25529 00010000:00010000:0.0:1782487582.778526:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778540:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778547:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778554:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.778558:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778564:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778570:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb57fd34000) 00010000:00010000:0.0:1782487582.778571:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.778573:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.778576:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b852e8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779145:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299200896:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.779166:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779271:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299201792:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.779286:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779368:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e083b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299202304:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.779381:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299202432:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.779396:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b852ed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779421:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293857536 00000100:00100000:0.0:1782487582.779424:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293857536 00010000:00010000:0.0:1782487582.779442:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 102 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779478:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6050 00000100:00100000:0.0:1782487582.779486:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2362:x1869066293857536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.779495:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.779500:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 103 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779533:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 103 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779548:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fe8fccc/0x66475b4e8b84e91d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1798:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c45 expref: 103 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779560:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.779563:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.779567:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779574:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779628:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.779652:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2362:x1869066293857536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.779662:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6050 00000100:00100000:0.0:1782487582.779679:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293858816 00000100:00100000:0.0:1782487582.779684:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293858816 00010000:00010000:0.0:1782487582.779702:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 89 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.779722:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6051 00000100:00100000:0.0:1782487582.779736:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2362:x1869066293857792:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.779745:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.779754:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b84e1fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1796:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a07 expref: 105 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779786:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b84e1fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1796:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a07 expref: 105 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779805:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b84e1fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1796:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473a07 expref: 106 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779827:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.779833:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.779838:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779859:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852ea6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1796:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779887:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.779909:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2362:x1869066293857792:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.779919:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6051 00000100:00100000:0.0:1782487582.779940:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6054 00000100:00100000:0.0:1782487582.779951:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2362:x1869066293858816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.779962:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.779969:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 88 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.779980:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 87 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780004:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0b09a9/0x66475b4e8b84ee09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x179c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df7 expref: 87 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780022:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.780040:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2362:x1869066293858816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.780056:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6054 00000100:00100000:0.0:1782487582.780073:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6057 00000100:00100000:0.0:1782487582.780083:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2362:x1869066293858432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.780090:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.780100:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 101 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780124:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 101 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780154:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b84e684 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1799:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473b11 expref: 100 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780211:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.780220:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.780241:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780264:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780283:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.780303:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2362:x1869066293858432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 219us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.780322:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6057 00000100:00100000:0.0:1782487582.780345:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293858944 00000100:00100000:0.0:1782487582.780349:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293858944 00000100:00100000:0.0:1782487582.780374:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1011 00000100:00100000:0.0:1782487582.780385:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+110:2362:x1869066293858944:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.780406:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.780414:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b852f16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e51 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780437:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780444:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780454:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780465:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780469:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780473:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780508:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780513:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780517:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780520:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.780522:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780527:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780534:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.780539:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.780542:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780550:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852f1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780556:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780569:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780576:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780582:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.780586:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780601:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780641:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x196d95a8 (ffff9cb4c4862500) 00010000:00010000:0.0:1782487582.780645:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.780650:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780657:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b852f24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780689:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b852f16 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e51 expref: 111 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780703:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.780709:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.780714:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b852f16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e51 expref: 111 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780725:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e600, rc -2) 00000100:00100000:0.0:1782487582.780752:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+110:2362:x1869066293858944:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 368us (973us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.780761:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1011 00010000:00010000:0.0:1782487582.780795:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780811:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780816:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780820:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.780823:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780827:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780836:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa73:0x0].0x0 (ffff9cb4e6ebc200) 00010000:00010000:0.0:1782487582.780838:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.780840:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780845:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446c00/0x66475b4e8b852f01 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780870:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780877:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780882:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780887:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b852ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.780898:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487582.781038:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+158:3317:x1869066299201280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6122us (6226us total) trans 8589939830 rc 0/0 00000100:00100000:0.0:1782487582.781050:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15607 00000100:00100000:0.0:1782487582.781075:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293859712 00000100:00100000:0.0:1782487582.781079:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293859712 00000100:00100000:0.0:1782487582.781096:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210202459744 time 7210202359744 state 0x1 ref 4 00000100:00100000:0.0:1782487582.781108:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210202598507 time 7210202498507 state 0x1 ref 4 00000100:00100000:0.0:1782487582.781124:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+550:293453:x1869066293859456:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487582.781147:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.781157:0:213684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8c00/0x66475b4e8b852ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a474e4a expref: 549 pid: 213684 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781177:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaaa:0x0].0x0 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.781185:0:213684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852f2b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781193:0:213684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852f2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781218:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852f2b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781249:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.781281:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781305:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852f2b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781326:0:213684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781342:0:213684:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450139600/0x66475b4e8b852f2b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781360:0:213684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.781405:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb560a05c00/2, rc 0, transno 8589939828 00000100:00100000:0.0:1782487582.781417:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb560a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299201536:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.781432:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781442:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781446:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781453:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007481fa0c/0x66475b4e8b852e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.781467:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.781600:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:3316:x1869066299200768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7196us (7317us total) trans 8589939832 rc 0/0 00000100:00100000:0.0:1782487582.781621:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15603 00000100:00100000:0.0:1782487582.782365:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5471d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299202944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.782395:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.782416:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782487582.782424:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5471d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299202816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.782448:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.782464:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299203328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.782494:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.782677:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299203328 00000100:00100000:0.0:1782487582.782682:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299203328 00000100:00100000:0.0:1782487582.782720:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299203200 00000100:00100000:0.0:1782487582.782725:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299203200 00000100:00100000:0.0:1782487582.782758:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15613 00000100:00100000:0.0:1782487582.782771:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+164:3316:x1869066299203072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.782789:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6047 count 1 00010000:00010000:0.0:1782487582.782806:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.782832:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 85 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.782843:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.782850:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.782860:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.782904:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 85 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.782925:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 85 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.782946:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299203584:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.782979:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00900 going to sleep for 11 seconds 00010000:00010000:0.0:1782487582.782998:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783030:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783038:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783054:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.783056:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783063:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783082:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4e6ebc500) 00010000:00010000:0.0:1782487582.783086:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.783090:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783104:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b852f4e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.783131:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15616 00000100:00100000:0.0:1782487582.783143:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+163:3316:x1869066299202688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.783157:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6045 count 1 00010000:00010000:0.0:1782487582.783167:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b852f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783177:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b84ee9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473e05 expref: 85 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783188:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.783197:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.783206:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b852f7f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783255:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b84ee9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e05 expref: 85 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783267:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b84ee9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e05 expref: 85 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.783294:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46e082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299204096:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.783338:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487582.783398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.783459:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.783505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.783583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487582.783631:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293860480 00000100:00100000:0.0:1782487582.783637:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293860480 00000100:00100000:0.0:1782487582.783661:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210202638237 time 7210202538237 state 0x1 ref 4 00000100:00100000:0.0:1782487582.783688:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210205163067 time 7210205076748 state 0x0 ref 4 00000100:00100000:0.0:1782487582.783712:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+553:293458:x1869066293860480:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.783724:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.783737:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b852f94 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e66 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783827:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783847:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783866:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783897:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783915:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.783937:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.784301:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17d1:0x0], index 1: 0 00010000:00010000:0.0:1782487582.784426:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b852fb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784436:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b852fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784444:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b852fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784473:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784480:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784486:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784491:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.784494:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784500:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784511:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.784514:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.784517:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784524:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b852fa2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.784536:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc57b9fd reply state 000000001cf143c6 transno 8589955762 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.784543:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487582.784564:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b852f94 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e66 expref: 555 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784577:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b852fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e66 expref: 554 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784588:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa76:0x0].0x0 (ffff9cb4c4862100) 00010000:00010000:0.0:1782487582.784591:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487582.784594:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e800, rc 0) 00000100:00100000:0.0:1782487582.784636:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+555:293458:x1869066293860480:12345-192.168.202.21@tcp:101:touch.500 Request processed in 929us (1054us total) trans 8589955762 rc 0/0 00000100:00100000:0.0:1782487582.784644:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25536 00010000:00010000:0.0:1782487582.784670:0:213684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.784675:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.784738:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063a886b3 reply state 00000000d8dd4dde transno 8589955763 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.784745:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.784782:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+556:293453:x1869066293859456:12345-192.168.202.21@tcp:36:touch.500 Request processed in 3660us (3916us total) trans 8589955763 rc 0/0 00000100:00100000:0.0:1782487582.784790:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25533 00000100:00100000:0.0:1782487582.784795:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210205163067 time 7210205076748 state 0x2 ref 0 00010000:00010000:0.0:1782487582.785855:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785863:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785870:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785877:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.785881:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785888:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785902:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa75:0x0].0x0 (ffff9cb4e6ebca00) 00010000:00010000:0.0:1782487582.785905:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.785909:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785922:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b852f9b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa75:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785947:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785955:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785962:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785968:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.785971:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785983:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.785997:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c4862400) 00010000:00010000:0.0:1782487582.786003:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.786008:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786016:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b852fa9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786045:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786052:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786060:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786066:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.786070:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786077:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786087:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaaa:0x0].0x0 (ffff9cb5588ee400) 00010000:00010000:0.0:1782487582.786090:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.786093:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786099:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b852f47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786122:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786129:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786136:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786142:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb450138200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.786146:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786154:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786164:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb57fd34200) 00010000:00010000:0.0:1782487582.786169:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.786184:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.786191:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb450138200/0x66475b4e8b852f0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.786248:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e082d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299204096:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.786270:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b852f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.786318:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46e080380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299203584:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.786338:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.787040:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293861248 00000100:00100000:0.0:1782487582.787046:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293861248 00010000:00010000:0.0:1782487582.787070:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 86 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.787120:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293860736 00000100:00100000:0.0:1782487582.787126:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293860736 00010000:00010000:0.0:1782487582.787144:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c0b090/0x66475b4e8b84f5e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474058 expref: 87 pid: 213211 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.787158:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293861120 00000100:00100000:0.0:1782487582.787163:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293861120 00010000:00010000:0.0:1782487582.787177:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc15c2aa/0x66475b4e8b84f5f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47404a expref: 88 pid: 190928 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.787196:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6060 00000100:00100000:0.0:1782487582.787208:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2360:x1869066293861248:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.787222:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.787240:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 88 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787256:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 88 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787300:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002522079f/0x66475b4e8b84eeb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x179f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e1a expref: 88 pid: 192482 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787320:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.787325:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x179f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.787337:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787362:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787401:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.787433:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2360:x1869066293861248:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 227us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.787450:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6060 00010000:00010000:0.0:1782487582.787512:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787521:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787532:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787539:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787561:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487582.787833:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+167:3316:x1869066299203072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5065us (5417us total) trans 8589939838 rc 0/0 00000100:00100000:0.0:1782487582.787844:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15613 00010000:00010000:0.0:1782487582.787869:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.787875:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787889:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.787896:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787906:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787926:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787948:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b852f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x179f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.787983:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.787989:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.787997:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788025:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.788033:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788042:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788065:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788075:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7c8ab7/0x66475b4e8b852f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788099:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.788104:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.788107:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.788121:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293862272 00000100:00100000:0.0:1782487582.788128:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293862272 00010000:00010000:0.0:1782487582.788149:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b84f5cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474035 expref: 81 pid: 213693 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.788178:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293862400 00000100:00100000:0.0:1782487582.788184:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293862400 00010000:00010000:0.0:1782487582.788204:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007336fd49/0x66475b4e8b84f5f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474043 expref: 82 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.788268:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6065 00000100:00100000:0.0:1782487582.788283:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb472813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2363:x1869066293861888:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.788299:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.788308:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098d37dd2/0x66475b4e8b84f8dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474100 expref: 97 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788336:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098d37dd2/0x66475b4e8b84f8dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474100 expref: 97 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788368:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d37dd2/0x66475b4e8b84f8dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474100 expref: 97 pid: 213221 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788392:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.788403:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.788413:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b852f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788426:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b852f78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.788458:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.788485:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2363:x1869066293861888:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 202us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.788503:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6065 00000004:00080000:0.0:1782487582.788549:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5471d0e00/2, rc 0, transno 8589939840 00000100:00100000:0.0:1782487582.788565:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5471d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299202944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.788823:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770fb80/2, rc 0, transno 8589939841 00000100:00100000:0.0:1782487582.788835:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299203328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.788922:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299204992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.789002:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487582.789242:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789255:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789272:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789282:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.789288:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789303:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789316:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa76:0x0].0x0 (ffff9cb4e6ebcd00) 00010000:00010000:0.0:1782487582.789320:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.789324:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789341:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff400/0x66475b4e8b852fcc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa76:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789375:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.789381:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789390:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.789394:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789407:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789431:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852fb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789442:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b852fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789468:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.789472:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.789474:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487582.789485:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293862656 00000100:00100000:0.0:1782487582.789491:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293862656 00000100:00100000:0.0:1782487582.789510:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210209697028 time 7210209723498 state 0x0 ref 1 00000100:00100000:0.0:1782487582.789526:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210209823498 time 7210209723498 state 0x1 ref 1 00000100:00100000:0.0:1782487582.789560:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210209823498 time 7210210947927 state 0x0 ref 1 00000100:00100000:0.0:1782487582.789581:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+556:293458:x1869066293862656:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487582.789592:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.789653:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852fef lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e7b expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789687:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852fef lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e7b expref: 557 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789714:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b852fef lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xa76:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e7b expref: 557 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.789743:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa76:0x0].0x0 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487582.789748:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487582.789753:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f400, rc 0) 00000100:00100000:0.0:1782487582.789779:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+557:293458:x1869066293862656:12345-192.168.202.21@tcp:101:touch.500 Request processed in 201us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.789787:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25540 00000100:00100000:0.0:1782487582.789792:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210209823498 time 7210210947927 state 0x2 ref 0 00000100:00100000:0.0:1782487582.790008:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299205888 00000100:00100000:0.0:1782487582.790013:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299205888 00000100:00100000:0.0:1782487582.790045:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15627 00000100:00100000:0.0:1782487582.790058:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:3314:x1869066299205888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487582.790073:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6058 count 1 00010000:00010000:0.0:1782487582.790088:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.790108:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 95 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.790126:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17aa:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782487582.790132:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.790138:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.790172:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 95 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.790199:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 95 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.790223:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299206144:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487582.790274:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb43c0 going to sleep for 11 seconds 00000004:00080000:0.0:1782487582.790313:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5471d0000/2, rc 0, transno 8589939844 00000100:00100000:0.0:1782487582.790325:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5471d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299202816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.790372:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57b518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299206272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.790408:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487582.793088:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57b51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299206144:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487582.793110:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.794534:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293863424 00000100:00100000:0.0:1782487582.794539:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293863424 00000100:00100000:0.0:1782487582.794568:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1013 00000100:00100000:0.0:1782487582.794578:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4cbabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+557:2363:x1869066293863424:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.794599:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.794644:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85305f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474e89 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794672:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794682:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794699:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794714:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794730:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794739:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794778:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794824:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794835:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794842:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.794846:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794857:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794867:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.794870:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.794874:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794888:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b853066 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794899:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794907:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794920:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794927:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.794932:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794944:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794954:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4c4862400) 00010000:00010000:0.0:1782487582.794957:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.794961:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794967:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85306d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.794999:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85305f lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e89 expref: 558 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795011:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.795018:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.795027:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85305f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474e89 expref: 558 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795037:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3fe00, rc -2) 00000100:00100000:0.0:1782487582.795068:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4cbabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+557:2363:x1869066293863424:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 492us (562us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.795082:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1013 00000100:00100000:0.0:1782487582.795112:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293863808 00000100:00100000:0.0:1782487582.795118:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293863808 00010000:00010000:0.0:1782487582.795137:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 97 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.795182:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293864320 00000100:00100000:0.0:1782487582.795187:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293864320 00010000:00010000:0.0:1782487582.795208:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d32d2aba/0x66475b4e8b84fb6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47419a expref: 100 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.795229:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293863936 00000100:00100000:0.0:1782487582.795246:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293863936 00010000:00010000:0.0:1782487582.795265:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf15560/0x66475b4e8b84feda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742b2 expref: 102 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.795304:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6068 00000100:00100000:0.0:1782487582.795320:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+80:2363:x1869066293863168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.795334:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.795344:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e66c54a/0x66475b4e8b84f60c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474066 expref: 79 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795372:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e66c54a/0x66475b4e8b84f60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474066 expref: 79 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795406:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e66c54a/0x66475b4e8b84f60c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474066 expref: 79 pid: 195192 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795422:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795426:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795432:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795444:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bc87d6/0x66475b4e8b852fe1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795473:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.795497:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2363:x1869066293863168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 181us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.795524:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6068 00000100:00100000:0.0:1782487582.795549:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6070 00000100:00100000:0.0:1782487582.795563:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066293863808:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.795578:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.795586:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 102 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795624:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 102 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795642:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070d619fc/0x66475b4e8b84fb99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741bd expref: 102 pid: 200304 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795655:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795659:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795663:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795691:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795719:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.795745:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066293863808:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 185us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.795761:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6070 00000100:00100000:0.0:1782487582.795783:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6072 00000100:00100000:0.0:1782487582.795795:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2363:x1869066293864320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.795806:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.795815:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d32d2aba/0x66475b4e8b84fb6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47419a expref: 98 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795835:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d32d2aba/0x66475b4e8b84fb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47419a expref: 98 pid: 213226 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795851:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795855:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.795860:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b852ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795870:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b852ff6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.795901:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.795924:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2363:x1869066293864320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 131us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.795937:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6072 00000100:00100000:0.0:1782487582.795961:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6074 00000100:00100000:0.0:1782487582.795973:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2363:x1869066293863936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.795985:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.795996:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaf15560/0x66475b4e8b84feda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742b2 expref: 95 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796023:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaf15560/0x66475b4e8b84feda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742b2 expref: 95 pid: 213223 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796039:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.796046:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.796055:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db46a03e/0x66475b4e8b853012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796081:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db46a03e/0x66475b4e8b853012 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796110:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.796136:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2363:x1869066293863936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.796160:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6074 00010000:00010000:0.0:1782487582.796209:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796219:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796251:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796273:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b853004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.796298:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487582.796489:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+174:3314:x1869066299205888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6432us (6499us total) trans 8589939847 rc 0/0 00000100:00100000:0.0:1782487582.796506:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15627 00000004:00080000:0.0:1782487582.796556:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c3b480/2, rc 0, transno 8589939847 00000100:00100000:0.0:1782487582.796572:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299205888:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487582.797849:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb45a53c000/2, rc 0, transno 8589939851 00000100:00100000:0.0:1782487582.797862:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299204992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487582.797881:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293865472 00000100:00100000:0.0:1782487582.797886:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293865472 00000100:00100000:0.0:1782487582.797905:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210214603557 time 7210216577657 state 0x0 ref 1 00000100:00100000:0.0:1782487582.797913:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210216677657 time 7210216577657 state 0x1 ref 1 00000100:00100000:0.0:1782487582.797932:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210216677657 time 7210219322768 state 0x0 ref 1 00000100:00100000:0.0:1782487582.797943:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+559:293444:x1869066293865472:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487582.797964:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487582.797981:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff800/0x66475b4e8b852c76 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xa69:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474da9 expref: 559 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798006:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b852759 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xa69:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d39 expref: 558 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798016:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa69:0x0].0x0 (ffff9cb4e6ebc100) 00010000:00010000:0.0:1782487582.798031:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487582.798042:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798053:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798060:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798070:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798075:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798081:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798148:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798156:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798167:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487582.798524:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2419, 64 off163008 00010000:00010000:0.0:1782487582.798593:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798603:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798625:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798632:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798638:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798642:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798652:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487582.798663:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798670:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798674:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798678:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.798683:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798697:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798706:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa69:0x0].0x0 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487582.798713:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.798717:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798732:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b8530b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xa69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798752:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798773:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798801:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798814:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.798821:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798840:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798856:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.798861:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.798865:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.798872:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8530a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487582.798892:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e19404 reply state 00000000ed17305e transno 8589955769 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.798900:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487582.798929:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+559:293444:x1869066293865472:12345-192.168.202.21@tcp:36:rm.500 Request processed in 990us (1104us total) trans 8589955769 rc 0/0 00000100:00100000:0.0:1782487582.798935:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25544 00000100:00100000:0.0:1782487582.798939:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210216677657 time 7210219322768 state 0x2 ref 0 00000100:00100000:0.0:1782487582.798971:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293865856 00000100:00100000:0.0:1782487582.798976:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293865856 00000100:00100000:0.0:1782487582.799014:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1014 00000100:00100000:0.0:1782487582.799028:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+560:2360:x1869066293865856:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.799051:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.799061:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b8530dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474ef9 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799108:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799115:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799121:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799132:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799136:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799143:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799182:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799187:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799191:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799195:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.799198:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799205:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799212:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.799214:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.799216:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799221:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b8530e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799243:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799250:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799257:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799262:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.799266:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799275:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799288:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c4862b00) 00010000:00010000:0.0:1782487582.799291:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.799294:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799298:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b8530eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799315:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b8530dd lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ef9 expref: 561 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799322:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.799324:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.799327:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b8530dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ef9 expref: 561 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799336:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f000, rc -2) 00000100:00100000:0.0:1782487582.799369:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+560:2360:x1869066293865856:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 346us (1479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.799374:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1014 00010000:00010000:0.0:1782487582.799401:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487582.799406:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799413:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.799417:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799423:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799433:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa69:0x0].0x0 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487582.799435:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782487582.799437:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799442:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b8530c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799459:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487582.799461:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b85300b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799467:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfe600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487582.799470:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b85300b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799476:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b85300b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799486:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b85300b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799490:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b85300b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799502:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.799504:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.799505:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487582.799515:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799522:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799525:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799528:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.799530:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799533:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799537:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4e6ebc400) 00010000:00010000:0.0:1782487582.799538:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.799540:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.799543:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edfee00/0x66475b4e8b85307b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487582.799570:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57b518e00/2, rc 0, transno 8589939854 00000100:00100000:0.0:1782487582.799583:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57b518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299206272:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487582.802417:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802427:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802434:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802441:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.802445:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802452:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802470:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4862500) 00010000:00010000:0.0:1782487582.802473:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.802478:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.802490:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b8530ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.802926:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293866496 00000100:00100000:0.0:1782487582.802931:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293866496 00010000:00010000:0.0:1782487582.802952:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b850a72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474608 expref: 76 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.802975:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293866112 00000100:00100000:0.0:1782487582.802978:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293866112 00010000:00010000:0.0:1782487582.802992:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077cc87bd/0x66475b4e8b850015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742d5 expref: 91 pid: 213220 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.803009:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293866624 00000100:00100000:0.0:1782487582.803012:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293866624 00010000:00010000:0.0:1782487582.803024:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e4f3571/0x66475b4e8b850292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743b5 expref: 77 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.803053:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6076 00000100:00100000:0.0:1782487582.803063:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2362:x1869066293866496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.803073:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.803080:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b850a72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474608 expref: 77 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803091:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b850a72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474608 expref: 77 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803113:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b850a72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474608 expref: 77 pid: 213227 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803123:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803130:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803135:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803145:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803166:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.803202:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:2362:x1869066293866496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 139us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.803213:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6076 00000100:00100000:0.0:1782487582.803241:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293865984 00000100:00100000:0.0:1782487582.803245:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293865984 00010000:00010000:0.0:1782487582.803263:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b84fee1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742b9 expref: 91 pid: 213210 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.803304:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6078 00000100:00100000:0.0:1782487582.803318:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:2360:x1869066293866624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.803330:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.803340:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e4f3571/0x66475b4e8b850292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743b5 expref: 75 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803359:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e4f3571/0x66475b4e8b850292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743b5 expref: 75 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803387:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4f3571/0x66475b4e8b850292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743b5 expref: 75 pid: 213225 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803400:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803405:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803410:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8530d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803429:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b8530d6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803453:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.803483:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2360:x1869066293866624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.803492:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6078 00000100:00100000:0.0:1782487582.803508:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293866240 00000100:00100000:0.0:1782487582.803514:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293866240 00010000:00010000:0.0:1782487582.803532:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7636f32/0x66475b4e8b8502b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d1 expref: 74 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.803570:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6080 00000100:00100000:0.0:1782487582.803583:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2360:x1869066293866240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487582.803596:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487582.803626:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7636f32/0x66475b4e8b8502b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d1 expref: 74 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803662:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7636f32/0x66475b4e8b8502b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d1 expref: 74 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803697:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7636f32/0x66475b4e8b8502b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d1 expref: 74 pid: 213384 timeout: 7310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803705:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803709:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487582.803713:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b8530ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803719:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b8530ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803735:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487582.803755:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2360:x1869066293866240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487582.803760:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6080 00010000:00010000:0.0:1782487582.803799:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803805:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803810:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803814:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004216d89/0x66475b4e8b8530cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.803825:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1782487582.803963:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:3314:x1869066299207936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5243us (5304us total) trans 8589939859 rc 0/0 00000100:00100000:0.0:1782487582.803977:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15636 00010000:00010000:0.0:1782487582.808824:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808834:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808845:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808851:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ede00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.808854:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808861:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808871:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb45a514900) 00010000:00010000:0.0:1782487582.808873:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.808877:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.808883:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85310e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.809321:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293867136 00000100:00100000:0.0:1782487582.809328:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293867136 00000100:00100000:0.0:1782487582.809363:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1016 00000100:00100000:0.0:1782487582.809370:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+559:2362:x1869066293867136:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.809389:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.809399:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853123 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a474f5b expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809435:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809445:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809460:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809471:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809476:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809480:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809510:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809523:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809531:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809540:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.809546:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809555:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809569:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.809573:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.809578:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809590:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85312a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809602:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809624:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809629:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809640:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.809644:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809653:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809663:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4c4862500) 00010000:00010000:0.0:1782487582.809664:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.809667:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809683:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853131 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809701:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853123 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474f5b expref: 558 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809708:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.809710:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.809714:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853123 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474f5b expref: 558 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.809723:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e000, rc -2) 00000100:00100000:0.0:1782487582.809767:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4526a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+557:2362:x1869066293867136:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 396us (473us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.809785:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1016 00010000:00010000:0.0:1782487582.811412:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811421:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811428:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811434:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.811437:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811443:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811454:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb57fd34300) 00010000:00010000:0.0:1782487582.811457:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.811460:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.811466:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85313f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824655:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824667:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824673:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824682:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.824686:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824694:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824705:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xa77:0x0].0x0 (ffff9cb45a514900) 00010000:00010000:0.0:1782487582.824708:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.824711:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.824717:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8800/0x66475b4e8b8532b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xa77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487582.840591:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293872512 00000100:00100000:0.0:1782487582.840597:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293872512 00000100:00100000:0.0:1782487582.840660:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1019 00000100:00100000:0.0:1782487582.840673:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+571:2362:x1869066293872512:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487582.840695:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487582.840703:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853368 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47507a expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840734:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840747:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840766:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840787:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840797:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840805:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840843:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840847:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840852:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840855:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.840858:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840863:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840871:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.840873:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.840875:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840879:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b853376 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840888:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840893:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840904:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840907:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487582.840910:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840922:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840928:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x9c0995a8 (ffff9cb4c4862500) 00010000:00010000:0.0:1782487582.840933:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487582.840937:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840945:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853384 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x9c0995a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840969:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853368 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47507a expref: 572 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.840980:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487582.840986:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487582.840991:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853368 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47507a expref: 572 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487582.841004:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e000, rc -2) 00000100:00100000:0.0:1782487582.841048:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+571:2362:x1869066293872512:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 379us (487us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487582.841062:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1019 00000100:00100000:0.0:1782487582.932799:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293881856 00000100:00100000:0.0:1782487582.932806:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293881856 00000100:00100000:0.0:1782487582.932847:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15656 00000100:00100000:0.0:1782487582.932862:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2363:x1869066293881856:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487582.933113:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2363:x1869066293881856:12345-192.168.202.21@tcp:2:touch.500 Request processed in 254us (347us total) trans 8589939865 rc 0/0 00000100:00100000:0.0:1782487582.933125:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15656 00000100:00100000:0.0:1782487583.006399:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293893504 00000100:00100000:0.0:1782487583.006406:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293893504 00000100:00100000:0.0:1782487583.006468:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15666 00000100:00100000:0.0:1782487583.006482:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+82:2360:x1869066293893504:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:0.0:1782487583.006716:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+83:2360:x1869066293893504:12345-192.168.202.21@tcp:2:touch.500 Request processed in 237us (857us total) trans 8589939869 rc 0/0 00000100:00100000:0.0:1782487583.006725:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15666 00000100:00100000:0.0:1782487583.034106:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066293901184 00000100:00100000:0.0:1782487583.034112:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066293901184 00010000:00010000:0.0:1782487583.034140:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37000/0x66475b4e8b853b2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xab3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752a3 expref: 591 pid: 190303 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.034190:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6081 00000100:00100000:0.0:1782487583.034204:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb477845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+591:2363:x1869066293901184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487583.034216:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487583.034225:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37000/0x66475b4e8b853b2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752a3 expref: 591 pid: 190303 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034250:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37000/0x66475b4e8b853b2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752a3 expref: 591 pid: 190303 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034273:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37000/0x66475b4e8b853b2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xab3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752a3 expref: 591 pid: 190303 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034301:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xab3:0x0].0x0 (ffff9cb4e73b9900) 00010000:00010000:0.0:1782487583.034307:0:213392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034321:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034348:0:213392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034377:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487583.034404:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb477845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+591:2363:x1869066293901184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 203us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487583.034413:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6081 00010000:00010000:0.0:1782487583.034443:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.034452:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487583.034967:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2420, 64 off163072 00010000:00010000:0.0:1782487583.035033:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035043:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035053:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035061:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035068:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035075:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b853ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xab3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035104:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487583.035117:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035125:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035134:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035151:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487583.035160:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035175:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035194:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xab3:0x0].0x0 (ffff9cb4e73b9900) 00010000:00010000:0.0:1782487583.035201:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487583.035205:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035213:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b853c60 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xab3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035253:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035262:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035273:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035279:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487583.035283:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035290:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035300:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487583.035304:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487583.035307:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.035313:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b853c52 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487583.035326:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000841a32b0 reply state 0000000064b12f42 transno 8589955850 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b853c59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.035334:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487583.035375:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb472813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+179:293530:x1869066293900288:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5311us (5551us total) trans 8589955850 rc 0/0 00000100:00100000:0.0:1782487583.035384:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25652 00000100:00100000:0.0:1782487583.035389:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210455660748 time 7210455578126 state 0x2 ref 0 00000100:00100000:0.0:1782487583.042292:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7210463771192 time 7210463680926 state 0x0 ref 2 00000100:00100000:0.0:1782487583.042306:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4bb705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+182:293536:x1869066293902720:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487583.042327:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487583.042340:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b853cd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xabe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475321 expref: 182 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.042351:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xabe:0x0].0x0 (ffff9cb558d81e00) 00010000:00010000:0.0:1782487583.042356:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487583.042400:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853d01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xabe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.042411:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853d01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xabe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.042422:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853d01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xabe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487583.042498:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb23fe4e reply state 00000000d7c7df4d transno 8589955854 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b853d01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xabe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.042507:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487583.042560:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4bb705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+184:293536:x1869066293902720:12345-192.168.202.21@tcp:36:touch.500 Request processed in 256us (673us total) trans 8589955854 rc 0/0 00000100:00100000:0.0:1782487583.042567:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 25659 00000100:00100000:0.0:1782487583.544143:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7210959160475 time 7210965529492 state 0x0 ref 2 00000100:00100000:0.0:1782487583.544162:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+707:293744:x1869066293992704:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487583.544207:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487583.544235:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b855aa5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475c58 expref: 707 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544265:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xacf:0x0].0x0 (ffff9cb44981bd00) 00010000:00010000:0.0:1782487583.544269:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487583.544319:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b855cab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xacf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544340:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b855366 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475a7c expref: 290 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544351:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85557a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475a21 expref: 290 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544359:0:213684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b855cab lrc: 5/0,1 mode: --/PW res: [0x200000bd1:0xacf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544391:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85557a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a475a21 expref: 290 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544417:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92c000/0x66475b4e8b85557a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a475a21 expref: 290 pid: 213684 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.544440:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299212544:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487583.544514:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b855366 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a475a7c expref: 291 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.544539:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050200/0x66475b4e8b855366 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xacf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a475a7c expref: 291 pid: 190302 timeout: 7310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.544580:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299212672:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487583.544652:0:213684:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782487583.940710:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294050560 00000100:00100000:0.0:1782487583.940715:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294050560 00000100:00100000:0.0:1782487583.940739:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211353655667 time 7211356891086 state 0x0 ref 1 00000100:00100000:0.0:1782487583.940750:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211356991086 time 7211356891086 state 0x1 ref 1 00000100:00100000:0.0:1782487583.940775:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211356991086 time 7211362163126 state 0x0 ref 1 00000100:00100000:0.0:1782487583.940796:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb449acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+360:293858:x1869066294050560:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487583.940832:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487583.940850:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b856c6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xae1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476191 expref: 360 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940877:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558610800/0x66475b4e8b856897 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xae1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4760b1 expref: 359 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940892:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xae1:0x0].0x0 (ffff9cb44273c100) 00010000:00010000:0.0:1782487583.940895:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487583.940907:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b856e2b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940916:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b856e2b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940922:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b856e2b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940930:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b856e32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940935:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b856e32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.940939:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b856e32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.941020:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b856e39 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xae1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.941027:0:213218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8569cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xae1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47610c expref: 755 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.941031:0:213218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b856e39 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xae1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.941056:0:213218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8569cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xae1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47610c expref: 755 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487583.941069:0:213218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8569cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xae1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47610c expref: 755 pid: 190303 timeout: 7311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487583.941082:0:213218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213218:1869066299216128:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487583.941128:0:213218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e00480 going to sleep for 11 seconds 00010000:00010000:0.0:1782487584.199658:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199672:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199679:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199685:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46bddba00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.199690:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199697:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199710:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf0:0x0].0x0 (ffff9cb548f15100) 00010000:00010000:0.0:1782487584.199713:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.199717:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.199723:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddba00/0x66475b4e8b857818 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.203854:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294082944 00000100:00100000:0.0:1782487584.203859:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294082944 00000100:00100000:0.0:1782487584.203988:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1081 00000100:00100000:0.0:1782487584.203998:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a57bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+379:2363:x1869066294082944:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487584.204030:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.204039:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857842 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476526 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204073:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204082:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204090:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204102:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204108:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204114:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204174:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204182:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204188:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487584.204202:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaee:0x0]: returning size 0 00000004:00200000:0.0:1782487584.204204:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487584.204214:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204309:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204317:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204323:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204329:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204335:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.204338:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204345:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204354:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.204358:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.204361:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204367:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857849 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204377:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204383:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204388:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204392:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.204395:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204400:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204407:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c4862b00) 00010000:00010000:0.0:1782487584.204409:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.204411:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204416:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204436:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857842 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476526 expref: 381 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204446:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b857857 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476526 expref: 380 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204452:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaee:0x0].0x0 (ffff9cb548f15000) 00010000:00010000:0.0:1782487584.204454:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.204456:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f200, rc 0) 00010000:00010000:0.0:1782487584.204461:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.204469:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85785e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47652d expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204489:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204496:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204502:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204511:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204516:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204522:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204569:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204577:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204584:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487584.204597:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaed:0x0]: returning size 0 00000004:00200000:0.0:1782487584.204600:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487584.204630:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204643:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204650:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204657:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204663:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204669:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.204672:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204730:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204742:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.204745:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.204748:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204754:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857865 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204764:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204770:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204777:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204783:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.204786:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204793:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204800:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c4862400) 00010000:00010000:0.0:1782487584.204802:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.204805:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204811:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b85786c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204832:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85785e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47652d expref: 382 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204842:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b857873 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47652d expref: 381 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204850:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaed:0x0].0x0 (ffff9cb548f15c00) 00010000:00010000:0.0:1782487584.204852:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.204854:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f000, rc 0) 00010000:00010000:0.0:1782487584.204859:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.204867:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85787a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476534 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204890:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204898:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204905:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204916:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204923:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204930:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204955:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204961:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204966:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204970:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.204973:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204981:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204989:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.204991:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.204993:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.204997:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857881 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205004:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205009:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205013:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205017:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.205019:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205024:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205029:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4862d00) 00010000:00010000:0.0:1782487584.205032:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.205034:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205040:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857888 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205058:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85787a lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476534 expref: 382 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205067:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.205069:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487584.205072:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85787a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476534 expref: 382 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.205080:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3ec00, rc -2) 00000100:00100000:0.0:1782487584.205125:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a57bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+381:2363:x1869066294082944:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1129us (1305us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487584.205133:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1081 00000100:00100000:0.0:1782487584.216226:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1084 00000100:00100000:0.0:1782487584.216242:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44981c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+387:2363:x1869066294084096:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487584.216278:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.216291:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85791b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4765ea expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216398:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216417:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216450:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216477:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216498:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216521:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216574:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216593:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216633:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216721:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.216730:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216743:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216774:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.216782:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.216788:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216798:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857930 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216821:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216837:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216848:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216860:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.216867:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216881:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216901:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4862d00) 00010000:00010000:0.0:1782487584.216906:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.216909:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216922:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857937 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216954:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85791b lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4765ea expref: 390 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216976:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.216980:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487584.216985:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85791b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4765ea expref: 390 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.216993:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3ec00, rc -2) 00000100:00100000:0.0:1782487584.217029:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44981c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+389:2363:x1869066294084096:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 792us (2192us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487584.217036:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1084 00010000:00010000:0.0:1782487584.235584:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235598:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235626:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235634:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.235642:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235653:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235669:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf1:0x0].0x0 (ffff9cb548f15200) 00010000:00010000:0.0:1782487584.235673:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.235677:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.235687:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b8579f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244456:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244468:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244476:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244482:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.244487:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244495:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244510:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf2:0x0].0x0 (ffff9cb543598e00) 00010000:00010000:0.0:1782487584.244513:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.244518:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.244525:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b857a25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252512:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252520:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252525:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252529:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.252531:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252534:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252541:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf3:0x0].0x0 (ffff9cb4cfe45900) 00010000:00010000:0.0:1782487584.252544:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.252546:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.252553:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b857a56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257358:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257377:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257393:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257400:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.257406:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257432:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257525:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf4:0x0].0x0 (ffff9cb49de08300) 00010000:00010000:0.0:1782487584.257585:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.257592:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.257604:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b857a8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.267941:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7211689380822 time 7211689329104 state 0x0 ref 2 00000100:00100000:0.0:1782487584.267959:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44981ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+409:293962:x1869066294089984:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487584.267971:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.267986:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857ae9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47667d expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268088:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268100:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268108:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268124:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b857afe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268135:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b857afe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268143:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b857afe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487584.268687:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x182f:0x0], index 0: 0 00010000:00010000:0.0:1782487584.268795:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857b05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268804:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268811:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268840:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268846:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268854:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268859:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.268863:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268870:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268882:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.268884:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.268888:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.268894:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857af7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.268903:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6e2e78a reply state 000000001cf143c6 transno 8589956277 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b857afe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.269017:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487584.269040:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857ae9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47667d expref: 413 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.269054:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857b05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47667d expref: 412 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.269061:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf7:0x0].0x0 (ffff9cb4c4862400) 00010000:00010000:0.0:1782487584.269063:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.269065:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e400, rc 0) 00000100:00100000:0.0:1782487584.269107:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44981ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+413:293962:x1869066294089984:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1153us (1872us total) trans 8589956277 rc 0/0 00000100:00100000:0.0:1782487584.269115:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26236 00000100:00100000:0.0:1782487584.269120:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7211689380822 time 7211689329104 state 0x2 ref 0 00000100:00100000:0.0:1782487584.278352:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294091008 00000100:00100000:0.0:1782487584.278359:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294091008 00000100:00100000:0.0:1782487584.278385:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211694554047 time 7211697976366 state 0x0 ref 1 00000100:00100000:0.0:1782487584.278400:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211698076366 time 7211697976366 state 0x1 ref 1 00000100:00100000:0.0:1782487584.278424:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211698076366 time 7211699813405 state 0x0 ref 1 00000100:00100000:0.0:1782487584.278436:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44981dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+412:293962:x1869066294091008:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487584.278450:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.278465:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857b3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47668b expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.278501:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857b3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47668b expref: 413 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.278514:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b857b3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xaf7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47668b expref: 413 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.278529:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf7:0x0].0x0 (ffff9cb4c4862b00) 00010000:00010000:0.0:1782487584.278532:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782487584.278535:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e000, rc 0) 00000100:00100000:0.0:1782487584.278579:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44981dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+413:293962:x1869066294091008:12345-192.168.202.21@tcp:101:touch.500 Request processed in 145us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487584.278585:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26240 00000100:00100000:0.0:1782487584.278590:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211698076366 time 7211699813405 state 0x2 ref 0 00000100:00100000:0.0:1782487584.279857:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294091776 00000100:00100000:0.0:1782487584.279863:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294091776 00000100:00100000:0.0:1782487584.279883:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211699913405 time 7211699813405 state 0x1 ref 4 00000100:00100000:0.0:1782487584.279915:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211701403860 time 7211701303860 state 0x1 ref 6 00000100:00100000:0.0:1782487584.279928:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44981fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+418:293961:x1869066294091392:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487584.279941:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.279953:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857b44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476692 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.279993:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280005:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280020:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280045:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280055:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280078:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280184:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280207:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280255:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487584.280290:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaee:0x0]: returning size 0 00000004:00200000:0.0:1782487584.280296:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487584.280313:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280329:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280627:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280643:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280650:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280751:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.280759:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280776:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280814:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.280821:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.280827:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280860:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b857b59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280881:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280896:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280916:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280929:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.280935:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280945:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280967:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c4862200) 00010000:00010000:0.0:1782487584.280972:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.280976:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.280995:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b857b67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.281033:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b857b44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476692 expref: 423 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.281080:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b857b91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476692 expref: 422 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.281106:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaee:0x0].0x0 (ffff9cb548f15000) 00010000:00010000:0.0:1782487584.281112:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.281116:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e200, rc 0) 00000100:00100000:0.0:1782487584.281147:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44981fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+420:293961:x1869066294091392:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1219us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487584.281163:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26241 00000100:00100000:0.0:1782487584.281937:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294092800 00000100:00100000:0.0:1782487584.281943:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294092800 00000100:00100000:0.0:1782487584.281962:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7211702619492 time 7211702519492 state 0x1 ref 2 00000100:00100000:0.0:1782487584.281986:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7211702619492 time 7211703376540 state 0x0 ref 2 00000100:00100000:0.0:1782487584.282002:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4964c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+422:293980:x1869066294092800:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487584.282012:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.282022:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857bec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4766ca expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282051:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282063:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282071:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282084:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282092:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282098:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282157:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282166:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282175:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487584.282198:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xaf1:0x0]: returning size 0 00000004:00200000:0.0:1782487584.282202:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487584.282212:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282232:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282240:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282246:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282256:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282262:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.282264:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282270:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282277:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.282280:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.282283:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282288:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b857bf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282297:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282302:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282308:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282313:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.282315:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282324:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282330:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c4862400) 00010000:00010000:0.0:1782487584.282332:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.282334:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282340:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b857bfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282357:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b857bec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ca expref: 423 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282369:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b857c01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xaf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ca expref: 422 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.282375:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaf1:0x0].0x0 (ffff9cb548f15e00) 00010000:00010000:0.0:1782487584.282378:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.282380:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3ec00, rc 0) 00000100:00100000:0.0:1782487584.282404:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4964c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+422:293980:x1869066294092800:12345-192.168.202.21@tcp:101:rm.500 Request processed in 406us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487584.282411:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26247 00000100:00100000:0.0:1782487584.708840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487584.708944:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294153344 00000100:00100000:0.0:1782487584.708951:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294153344 00000100:00100000:0.0:1782487584.708977:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212125080282 time 7212127532782 state 0x0 ref 1 00000100:00100000:0.0:1782487584.708990:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212127632782 time 7212127532782 state 0x1 ref 1 00000100:00100000:0.0:1782487584.709006:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212127632782 time 7212130396846 state 0x0 ref 1 00000100:00100000:0.0:1782487584.709014:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+487:294101:x1869066294153344:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1782487584.709032:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.709046:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b858fdb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476cff expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709149:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709177:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709192:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709230:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b858fe9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709266:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b858fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.709293:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b858fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487584.709995:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1840:0x0], index 0: 0 00010000:00010000:0.0:1782487584.710158:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85900c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710172:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85900c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710180:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85900c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710228:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710233:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710238:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710241:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.710244:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710248:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710257:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.710258:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.710261:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710264:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b858fe2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.710273:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009055b880 reply state 00000000ea0f9954 transno 8589956428 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b858fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.710279:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487584.710308:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b858fdb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cff expref: 491 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710320:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85900c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cff expref: 489 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.710325:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb09:0x0].0x0 (ffff9cb4c4862200) 00010000:00010000:0.0:1782487584.710327:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.710329:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3fe00, rc 0) 00000100:00100000:0.0:1782487584.710395:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+490:294101:x1869066294153344:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1380us (1562us total) trans 8589956428 rc 0/0 00000100:00100000:0.0:1782487584.710405:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26435 00000100:00100000:0.0:1782487584.710413:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212127632782 time 7212130396846 state 0x2 ref 0 00000100:00100000:0.0:1782487584.790678:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294165632 00000100:00100000:0.0:1782487584.790686:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294165632 00000100:00100000:0.0:1782487584.790892:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212212173695 time 7212212073695 state 0x1 ref 3 00000100:00100000:0.0:1782487584.790933:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212212173695 time 7212212321674 state 0x0 ref 3 00000100:00100000:0.0:1782487584.790950:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44ed04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294122:x1869066294165632:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487584.790993:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.791019:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1e00/0x66475b4e8b85955a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ed4 expref: 546 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.791042:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb11:0x0].0x0 (ffff9cb44297d600) 00010000:00010000:0.0:1782487584.791061:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487584.791137:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859584 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.791146:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.791153:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.791329:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006829dfa2 reply state 00000000e349448c transno 8589956453 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.791339:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.791445:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44ed04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:294122:x1869066294165632:12345-192.168.202.21@tcp:36:touch.500 Request processed in 498us (953us total) trans 8589956453 rc 0/0 00000100:00100000:0.0:1782487584.791470:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26469 00010000:00010000:3.0:1782487584.792320:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.792323:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859576 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.792327:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859576 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.792332:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.792333:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.792335:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859576 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.792338:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859576 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.792345:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b27763c5 reply state 000000000202efcf transno 8589956454 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b85957d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.792393:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.792469:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44ed05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+546:294108:x1869066294165376:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1577us (2123us total) trans 8589956454 rc 0/0 00000100:00100000:3.0:1782487584.792480:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26468 00000100:00100000:3.0:1782487584.792488:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212212173695 time 7212212321674 state 0x2 ref 0 00000100:00100000:3.0:1782487584.796596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487584.796974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.797034:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294166016 00000100:00100000:3.0:1782487584.797039:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294166016 00000100:00100000:3.0:1782487584.797061:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212212421674 time 7212218184875 state 0x0 ref 1 00000100:00100000:3.0:1782487584.797068:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212218284875 time 7212218184875 state 0x1 ref 1 00000100:00100000:3.0:1782487584.797085:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212218284875 time 7212218476828 state 0x0 ref 1 00000100:00100000:3.0:1782487584.797096:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+546:294109:x1869066294166016:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.797143:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487584.797204:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b858f6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cab expref: 546 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797235:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b858e68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c6c expref: 545 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797248:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b858d1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb02:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c18 expref: 544 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797260:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb02:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487584.797269:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.797285:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797294:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797301:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797312:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797337:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797345:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797584:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797595:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.797656:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487584.798671:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2483, 64 off167104 00010000:00010000:3.0:1782487584.799185:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799211:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799231:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799242:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799250:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799257:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799282:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.799307:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799319:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799325:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799339:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.799344:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799353:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799372:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb02:0x0].0x0 (ffff9cb44a127900) 00010000:00010000:3.0:1782487584.799376:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.799379:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799386:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799410:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799416:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799421:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799439:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.799447:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799465:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799476:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.799480:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.799486:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.799534:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.799547:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000161aa662 reply state 0000000036646b37 transno 8589956455 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.799555:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.799642:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+544:294109:x1869066294166016:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2543us (2666us total) trans 8589956455 rc 0/0 00000100:00100000:3.0:1782487584.799653:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26471 00000100:00100000:3.0:1782487584.799661:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212218284875 time 7212218476828 state 0x2 ref 0 00010000:00010000:3.0:1782487584.805697:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.805710:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b8595d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.805722:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.805727:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b8595d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.805739:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b8595d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.805764:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb00:0x0].0x0 (ffff9cb442727200) 00010000:00010000:3.0:1782487584.805767:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.805773:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b8595d1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.805780:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b8595d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.805815:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.805820:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.805826:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487584.810538:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294167296 00000100:00100000:3.0:1782487584.810550:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294167296 00000100:00100000:3.0:1782487584.810594:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212218576828 time 7212223984361 state 0x0 ref 1 00000100:00100000:3.0:1782487584.810682:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212224084361 time 7212223984361 state 0x1 ref 1 00000100:00100000:3.0:1782487584.810725:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212224084361 time 7212232114804 state 0x0 ref 1 00000100:00100000:3.0:1782487584.810744:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+543:294097:x1869066294167296:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.810799:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487584.810829:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b858efb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c8f expref: 543 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810865:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b858c8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xaff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476bee expref: 542 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810885:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaff:0x0].0x0 (ffff9cb562461000) 00010000:00010000:3.0:1782487584.810901:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.810927:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810941:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810952:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810970:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810977:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.810986:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.811137:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.811146:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.811157:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487584.811907:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2491, 64 off167616 00010000:00010000:3.0:1782487584.812038:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812049:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812058:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812068:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812076:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812084:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b8595ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812111:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.812129:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812136:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812143:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812150:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.812156:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812166:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812204:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xaff:0x0].0x0 (ffff9cb44a127600) 00010000:00010000:3.0:1782487584.812230:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.812237:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812252:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b8595e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812286:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812298:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812308:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812343:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.812351:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812363:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812380:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.812384:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.812391:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.812403:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b8595d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.812423:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df436950 reply state 000000007329a5e3 transno 8589956459 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b8595df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.812436:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.812533:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+543:294097:x1869066294167296:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1793us (2080us total) trans 8589956459 rc 0/0 00000100:00100000:3.0:1782487584.812547:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26473 00000100:00100000:3.0:1782487584.812554:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212224084361 time 7212232114804 state 0x2 ref 0 00000100:00100000:3.0:1782487584.824925:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294167808 00000100:00100000:3.0:1782487584.824937:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294167808 00000100:00100000:0.0:1782487584.824957:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294168064 00000100:00100000:0.0:1782487584.824971:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294168064 00000100:00100000:3.0:1782487584.824978:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212232214804 time 7212240343612 state 0x0 ref 1 00000100:00100000:3.0:1782487584.824992:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212240443612 time 7212240343612 state 0x1 ref 1 00000100:00100000:0.0:1782487584.825013:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212240443612 time 7212240343612 state 0x1 ref 2 00000100:00100000:3.0:1782487584.825035:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212246523222 time 7212246423222 state 0x1 ref 2 00000100:00100000:3.0:1782487584.825055:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+885:294145:x1869066294167808:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:0.0:1782487584.825055:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212246523222 time 7212246445199 state 0x0 ref 2 00000100:00100000:0.0:1782487584.825084:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+541:294112:x1869066294168064:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.825095:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.825118:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859610 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476ee9 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825153:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487584.825179:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b858e37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c7a expref: 540 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825205:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b858d50 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb03:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c26 expref: 539 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825230:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb03:0x0].0x0 (ffff9cb562461200) 00010000:00010000:0.0:1782487584.825243:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487584.825268:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825280:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825287:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825302:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825310:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825323:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b859625 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825327:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825355:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b859625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825369:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85962c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825369:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b859625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825400:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85962c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.825409:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85962c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825526:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825534:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.825540:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782487584.826043:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2492, 64 off167680 00010000:00010000:0.0:1782487584.826097:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826105:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826110:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826116:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826121:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826124:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85963a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826142:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487584.826159:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826163:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826166:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826169:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.826172:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826176:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826183:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb03:0x0].0x0 (ffff9cb4c4862900) 00010000:00010000:0.0:1782487584.826185:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487584.826188:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826194:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859633 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826211:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826228:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826234:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826239:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.826242:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826249:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826258:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.826260:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.826263:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.826269:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b859617 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.826284:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be1f4c50 reply state 000000005dcc3dad transno 8589956461 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b859625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.826294:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.826396:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+540:294112:x1869066294168064:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1315us (1494us total) trans 8589956461 rc 0/0 00000100:00100000:0.0:1782487584.826403:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26476 00000004:00080000:3.0:1782487584.826728:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x181e:0x0], index 1: 0 00010000:00010000:3.0:1782487584.827014:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b859641 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827028:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b859641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827039:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b859641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827077:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827084:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827091:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827099:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.827106:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827115:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827137:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.827141:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.827146:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827153:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85961e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.827171:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070933fcc reply state 00000000e353eed8 transno 8589956462 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85962c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.827179:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.827224:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859610 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ee9 expref: 888 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827249:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b859641 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ee9 expref: 887 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.827259:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb44a127400) 00010000:00010000:3.0:1782487584.827262:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.827265:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb55647f400, rc 0) 00000100:00100000:3.0:1782487584.827354:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+888:294145:x1869066294167808:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2302us (2619us total) trans 8589956462 rc 0/0 00000100:00100000:3.0:1782487584.827366:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26475 00000100:00100000:3.0:1782487584.827377:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212246523222 time 7212246445199 state 0x2 ref 0 00000100:00100000:3.0:1782487584.835002:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294168448 00000100:00100000:3.0:1782487584.835008:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294168448 00000100:00100000:0.0:1782487584.835013:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212256499902 time 7212256399902 state 0x1 ref 2 00000100:00100000:0.0:1782487584.835039:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+541:294132:x1869066294168192:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:0.0:1782487584.835064:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.835087:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b859664 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476ef0 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835158:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835188:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835204:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835231:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835241:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835279:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835442:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835456:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.835463:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212256519563 time 7212256419563 state 0x1 ref 3 00010000:00010000:0.0:1782487584.835484:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.835510:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212256519563 time 7212256898330 state 0x0 ref 3 00000004:00200000:0.0:1782487584.835534:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb0c:0x0]: returning size 0 00000004:00200000:0.0:1782487584.835548:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1782487584.835569:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+543:294138:x1869066294168448:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.835584:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:0.0:1782487584.835600:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835603:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85969c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f05 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835696:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835710:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835719:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835736:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835764:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.835768:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835788:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835798:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835821:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835838:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835846:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487584.835858:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.835860:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835865:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835891:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859672 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835893:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.835925:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835932:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835956:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835989:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.835997:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487584.836002:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836020:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836021:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836057:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836058:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4c4862100) 00010000:00010000:0.0:1782487584.836065:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.836071:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836101:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836107:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859679 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487584.836145:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb0e:0x0]: returning size 0 00000004:00200000:3.0:1782487584.836159:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:0.0:1782487584.836167:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b859664 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ef0 expref: 549 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.836172:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836208:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836231:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f200/0x66475b4e8b85968e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb0c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ef0 expref: 548 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836276:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0c:0x0].0x0 (ffff9cb54c47f200) 00010000:00010000:0.0:1782487584.836281:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.836286:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836288:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f200, rc 0) 00010000:00010000:3.0:1782487584.836311:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.836345:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294132:x1869066294168192:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1314us (2691us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487584.836352:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.836368:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26477 00010000:00010000:3.0:1782487584.836399:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.836406:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.836424:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212257913443 time 7212257813443 state 0x1 ref 7 00010000:00010000:3.0:1782487584.836425:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836447:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:0.0:1782487584.836450:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+888:294145:x1869066294168960:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487584.836458:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.836466:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836492:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b8596a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836499:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.836529:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb55647f400/0x66475b4e8b859641 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ee9 expref: 888 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836538:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836567:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836570:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb44a127400) 00010000:00010000:3.0:1782487584.836586:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836588:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.836655:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578dea800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.836662:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836675:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836685:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb44a127700) 00010000:00010000:3.0:1782487584.836691:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.836696:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836698:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836728:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b8596aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836738:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.836774:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836797:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85969c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f05 expref: 549 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836856:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f05 expref: 548 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.836876:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0e:0x0].0x0 (ffff9cb54c47f700) 00010000:00010000:3.0:1782487584.836880:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.836885:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb400, rc 0) 00000100:00100000:3.0:1782487584.836918:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294138:x1869066294168448:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1393us (3154us total) trans 0 rc 0/0 00000004:00010000:0.0:1782487584.836939:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d00c462a reply state 00000000671d6590 transno 8589956463 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.836954:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26479 00000100:00100000:0.0:1782487584.836973:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.836985:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212258475877 time 7212258375877 state 0x1 ref 6 00000100:00100000:3.0:1782487584.837014:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294139:x1869066294169088:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:0.0:1782487584.837021:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+889:294145:x1869066294168960:12345-192.168.202.21@tcp:36:touch.500 Request processed in 575us (1480us total) trans 8589956463 rc 0/0 00010000:00010000:3.0:1782487584.837041:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1782487584.837047:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26481 00010000:00010000:3.0:1782487584.837052:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8596f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f13 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.837069:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212258556566 time 7212258456566 state 0x1 ref 5 00000100:00100000:0.0:1782487584.837101:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294143:x1869066294169216:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.837120:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837120:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487584.837132:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b8596fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f1a expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837149:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837169:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837175:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837182:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837234:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837260:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837300:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837329:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837345:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837349:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837404:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837405:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837449:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837456:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487584.837492:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb0f:0x0]: returning size 0 00000004:00200000:3.0:1782487584.837499:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:0.0:1782487584.837504:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.837512:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837541:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837542:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837575:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837576:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837650:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837665:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782487584.837667:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb11:0x0]: returning size 0 00000004:00200000:0.0:1782487584.837680:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782487584.837698:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837725:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.837731:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837733:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837756:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837770:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837808:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837841:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837845:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.837861:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.837868:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.837869:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837878:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837896:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8596f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837920:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.837925:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837952:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.837968:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.837971:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.837980:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838007:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838011:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b859705 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838036:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.838047:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838051:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838077:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838080:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838099:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838107:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb44a127900) 00010000:00010000:0.0:1782487584.838108:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.838112:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.838115:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838117:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838135:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85970c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838139:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838177:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487584.838188:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487584.838194:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838204:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85971a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838205:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8596f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f13 expref: 548 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838242:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b859713 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f13 expref: 547 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838258:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0f:0x0].0x0 (ffff9cb4d2ebc200) 00010000:00010000:0.0:1782487584.838261:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b8596fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f1a expref: 548 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.838270:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.838276:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35ec000, rc 0) 00010000:00010000:0.0:1782487584.838297:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b859721 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f1a expref: 547 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.838306:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb11:0x0].0x0 (ffff9cb562461100) 00010000:00010000:0.0:1782487584.838309:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782487584.838313:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e800, rc 0) 00000100:00100000:3.0:1782487584.838316:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:294139:x1869066294169088:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1310us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.838326:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26482 00000100:00100000:0.0:1782487584.838348:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+545:294143:x1869066294169216:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1248us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487584.838357:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26483 00010000:00010000:3.0:1782487584.839370:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839381:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839388:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839399:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.839404:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839412:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839425:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb4c4862900) 00010000:00010000:3.0:1782487584.839428:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.839432:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839440:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e400/0x66475b4e8b8596d4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.839753:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294169728 00000100:00100000:3.0:1782487584.839761:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294169728 00000100:00100000:3.0:1782487584.839797:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212259152760 time 7212259052760 state 0x1 ref 2 00000100:00100000:3.0:1782487584.839830:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212259152760 time 7212261219950 state 0x0 ref 2 00000100:00100000:3.0:1782487584.839845:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+890:294145:x1869066294169728:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.839865:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.839882:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85973d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f2f expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839925:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85973d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f2f expref: 891 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839944:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85973d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f2f expref: 891 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.839963:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb44a127c00) 00010000:00010000:3.0:1782487584.839967:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487584.839970:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35eda00, rc 0) 00000100:00100000:3.0:1782487584.840022:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+891:294145:x1869066294169728:12345-192.168.202.21@tcp:101:touch.500 Request processed in 180us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.840031:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26485 00000100:00100000:3.0:1782487584.841926:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294169856 00000100:00100000:3.0:1782487584.841937:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294169856 00000100:00100000:3.0:1782487584.842000:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15992 00000100:00100000:3.0:1782487584.842011:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+174:2360:x1869066294169856:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.842112:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.842137:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f36 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487584.842171:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x181d:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487584.842194:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487584.842288:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487584.842307:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 175 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.842332:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 175 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.842407:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35ec400, rc 0) 00000100:00100000:3.0:1782487584.842449:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+175:2360:x1869066294169856:12345-192.168.202.21@tcp:101:rm.500 Request processed in 439us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.842459:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15992 00000100:00100000:3.0:1782487584.842573:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294169984 00000100:00100000:3.0:1782487584.842581:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294169984 00000100:00100000:3.0:1782487584.842666:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1133 00000100:00100000:3.0:1782487584.842679:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+544:2362:x1869066294169984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487584.842688:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.842709:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b8596b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f05 expref: 544 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.842722:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0e:0x0].0x0 (ffff9cb54c47f700) 00010000:00010000:3.0:1782487584.842725:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487584.842746:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+543:2362:x1869066294169984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.842752:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1133 00000100:00100000:3.0:1782487584.842775:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294170240 00000100:00100000:3.0:1782487584.842780:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294170240 00000100:00100000:3.0:1782487584.842863:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1134 00000100:00100000:3.0:1782487584.842875:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+543:2362:x1869066294170240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487584.842885:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.842902:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0a00/0x66475b4e8b859695 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ef7 expref: 543 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.842922:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0d:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:3.0:1782487584.842926:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487584.842960:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+542:2362:x1869066294170240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.842970:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1134 00000100:00100000:3.0:1782487584.843485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.843557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.843852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.843911:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294170752 00000100:00100000:3.0:1782487584.843917:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294170752 00000100:00100000:3.0:1782487584.843952:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212261319950 time 7212261219950 state 0x1 ref 2 00000100:00100000:3.0:1782487584.843995:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212261319950 time 7212265383597 state 0x0 ref 2 00000100:00100000:3.0:1782487584.844017:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+544:294116:x1869066294170752:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.844062:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487584.844092:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b858f48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ca4 expref: 544 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844127:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b858d81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb04:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c34 expref: 543 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844160:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb04:0x0].0x0 (ffff9cb5533b4500) 00010000:00010000:3.0:1782487584.844177:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.844197:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844247:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844262:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844283:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844299:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844312:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844454:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844463:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.844486:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487584.845822:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2486, 64 off167296 00010000:00010000:3.0:1782487584.846010:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846022:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846032:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846042:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846050:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846057:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85978a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846081:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.846100:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846108:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846117:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846127:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.846135:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846148:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846324:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb04:0x0].0x0 (ffff9cb562461200) 00010000:00010000:3.0:1782487584.846332:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.846339:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846352:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b859783 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846387:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846396:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846404:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.846405:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294171648 00000100:00100000:0.0:1782487584.846412:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294171648 00010000:00010000:3.0:1782487584.846414:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.846419:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846426:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.846437:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.846444:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782487584.846444:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212265483597 time 7212265383597 state 0x1 ref 2 00010000:00010000:3.0:1782487584.846452:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.846480:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212265483597 time 7212267869560 state 0x0 ref 2 00000100:00100000:0.0:1782487584.846499:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+891:294147:x1869066294171648:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487584.846511:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b859775 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.846524:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a4047fd reply state 000000005d9cedc6 transno 8589956465 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.846535:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782487584.846535:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.846558:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d400/0x66475b4e8b859752 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f21 expref: 891 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.846577:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaca:0x0].0x0 (ffff9cb4c5b3dc00) 00010000:00010000:0.0:1782487584.846596:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487584.846603:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+542:294116:x1869066294170752:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2588us (3048us total) trans 8589956465 rc 0/0 00000100:00100000:3.0:1782487584.846651:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26486 00010000:00010000:0.0:1782487584.846701:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859791 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.846716:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859791 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.846725:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859791 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.846816:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099a4e6ab reply state 00000000d861d66d transno 8589956467 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859791 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.846827:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.846880:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+894:294147:x1869066294171648:12345-192.168.202.21@tcp:36:touch.500 Request processed in 386us (517us total) trans 8589956467 rc 0/0 00000100:00100000:0.0:1782487584.846886:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26487 00010000:00010000:3.0:1782487584.849082:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849092:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849101:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849109:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.849115:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849160:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849178:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb44a127600) 00010000:00010000:3.0:1782487584.849183:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.849189:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849196:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85977c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849250:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849259:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849272:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849278:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.849284:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849293:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849307:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb44297d100) 00010000:00010000:3.0:1782487584.849310:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.849314:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.849322:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b8597a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.849732:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294171904 00000100:00100000:3.0:1782487584.849740:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294171904 00000100:00100000:3.0:1782487584.849774:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212267969560 time 7212268145250 state 0x0 ref 1 00000100:00100000:3.0:1782487584.849787:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212268245250 time 7212268145250 state 0x1 ref 1 00000100:00100000:3.0:1782487584.849817:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294172032 00000100:00100000:3.0:1782487584.849820:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294172032 00000100:00100000:3.0:1782487584.849844:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212271312135 time 7212271212135 state 0x1 ref 2 00000100:00100000:3.0:1782487584.849882:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212271312135 time 7212271271339 state 0x0 ref 2 00000100:00100000:3.0:1782487584.849901:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+541:294118:x1869066294172032:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.849942:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487584.849968:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b858fd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb05:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cc0 expref: 541 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850006:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b858db2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb05:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c42 expref: 540 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850033:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb05:0x0].0x0 (ffff9cb4b4027600) 00010000:00010000:3.0:1782487584.850054:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.850072:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850084:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850096:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850116:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850125:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850135:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850329:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850338:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.850348:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.850833:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294172288 00000100:00100000:0.0:1782487584.850847:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294172288 00000100:00100000:0.0:1782487584.850891:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212271371339 time 7212271271339 state 0x1 ref 3 00000100:00100000:0.0:1782487584.850962:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212272435924 time 7212272350422 state 0x0 ref 3 00000100:00100000:0.0:1782487584.851001:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+896:294148:x1869066294172288:12345-192.168.202.21@tcp:36:touch.500 00000040:00080000:3.0:1782487584.851036:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2493, 64 off167744 00010000:00010000:0.0:1782487584.851050:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.851077:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1200/0x66475b4e8b8597ad lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f4b expref: 897 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.851109:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacb:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:0.0:1782487584.851128:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.851134:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851174:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851196:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.851210:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b8597ec lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851234:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851259:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.851261:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b8597ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851267:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8597de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb05:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.851304:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b8597ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851319:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.851344:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851352:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851363:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851388:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.851394:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851405:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851435:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb05:0x0].0x0 (ffff9cb562461000) 00010000:00010000:3.0:1782487584.851441:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.851447:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851455:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b8597d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb05:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.851467:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005dc7909d reply state 000000009a88f48d transno 8589956470 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b8597ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851475:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.851491:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.851500:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851506:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851511:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.851515:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851522:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851534:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.851537:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.851541:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.851547:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b8597c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.851557:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086720350 reply state 00000000ddd43bc2 transno 8589956469 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.851565:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.852687:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+899:294148:x1869066294172288:12345-192.168.202.21@tcp:36:touch.500 Request processed in 1686us (1964us total) trans 8589956470 rc 0/0 00000100:00100000:0.0:1782487584.852702:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26492 00000100:00100000:3.0:1782487584.852717:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+541:294118:x1869066294172032:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2822us (2954us total) trans 8589956469 rc 0/0 00000100:00100000:3.0:1782487584.852728:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26490 00000100:00100000:3.0:1782487584.856037:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294172672 00000100:00100000:3.0:1782487584.856047:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294172672 00000100:00100000:3.0:1782487584.856125:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15995 00000100:00100000:3.0:1782487584.856143:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2363:x1869066294172672:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487584.856561:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+64:2363:x1869066294172672:12345-192.168.202.21@tcp:2:touch.500 Request processed in 421us (684us total) trans 8589940616 rc 0/0 00000100:00100000:3.0:1782487584.856573:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15995 00010000:00010000:3.0:1782487584.859223:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859239:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859251:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859260:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.859266:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859275:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859298:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb562461e00) 00010000:00010000:3.0:1782487584.859302:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.859309:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.859340:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b8597c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.859796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487584.859831:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294173056 00000100:00100000:0.0:1782487584.859838:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294173056 00000100:00100000:0.0:1782487584.859861:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212272450422 time 7212280857390 state 0x0 ref 1 00000100:00100000:0.0:1782487584.859870:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212280957390 time 7212280857390 state 0x1 ref 1 00000100:00100000:0.0:1782487584.859894:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212280957390 time 7212281285343 state 0x0 ref 1 00000100:00100000:0.0:1782487584.859903:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+540:294120:x1869066294173056:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:0.0:1782487584.859952:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782487584.859971:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b858fa3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb06:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cb9 expref: 540 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.859990:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b858de3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb06:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476c50 expref: 539 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860000:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb06:0x0].0x0 (ffff9cb46022f800) 00010000:00010000:0.0:1782487584.860009:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487584.860027:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85980f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.860043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487584.860054:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85980f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860067:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85980f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860084:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b859816 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860096:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b859816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.860097:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487584.860111:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b859816 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.860146:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487584.860285:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859824 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb06:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860297:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859824 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb06:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860306:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b859824 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb06:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.860652:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212281724727 time 7212282040595 state 0x0 ref 3 00000100:00100000:0.0:1782487584.860674:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+901:294151:x1869066294173824:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487584.860703:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.860720:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b8597fa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f59 expref: 900 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860732:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacc:0x0].0x0 (ffff9cb44297da00) 00010000:00010000:0.0:1782487584.860741:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487584.860808:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860818:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.860827:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782487584.860936:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009287774b reply state 00000000a22ff91b transno 8589956473 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.860953:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.861018:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+901:294151:x1869066294173824:12345-192.168.202.21@tcp:36:touch.500 Request processed in 347us (872us total) trans 8589956473 rc 0/0 00000100:00100000:3.0:1782487584.861024:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294173952 00000100:00100000:0.0:1782487584.861029:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26496 00000100:00100000:3.0:1782487584.861035:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294173952 00010000:00010000:3.0:1782487584.861993:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862004:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862017:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862024:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.862031:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862041:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862059:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacc:0x0].0x0 (ffff9cb4c4862b00) 00010000:00010000:3.0:1782487584.862064:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.862072:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862125:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e000/0x66475b4e8b859839 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862693:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862702:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862710:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862726:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46bddb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.862730:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862742:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862757:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c5b3db00) 00010000:00010000:3.0:1782487584.862760:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.862764:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.862770:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddb400/0x66475b4e8b859832 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.864019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.864089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.864209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487584.864275:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212283689306 time 7212285662788 state 0x0 ref 1 00000100:00100000:0.0:1782487584.864296:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+903:294152:x1869066294174592:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:0.0:1782487584.864332:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487584.864353:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46bddac00/0x66475b4e8b859840 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f67 expref: 904 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.864371:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacd:0x0].0x0 (ffff9cb4c5b3d300) 00010000:00010000:0.0:1782487584.864390:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487584.864458:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.864477:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487584.864490:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.864520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00010000:0.0:1782487584.864571:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b98d4142 reply state 00000000320729fd transno 8589956477 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487584.864582:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782487584.864691:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+905:294152:x1869066294174592:12345-192.168.202.21@tcp:36:touch.500 Request processed in 399us (609us total) trans 8589956477 rc 0/0 00000100:00100000:0.0:1782487584.864710:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26498 00010000:00010000:3.0:1782487584.865937:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.865995:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.866158:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.866201:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.866211:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.866236:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.866297:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacd:0x0].0x0 (ffff9cb4c4862d00) 00010000:00010000:3.0:1782487584.866304:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.866312:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.866321:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ee00/0x66475b4e8b859863 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.867437:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.867450:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b8598a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.867510:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.867525:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b8598a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.867547:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b8598a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.867599:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb07:0x0].0x0 (ffff9cb442727200) 00010000:00010000:3.0:1782487584.867687:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.867757:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b8598a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.867786:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b8598a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868228:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868239:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868247:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868254:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.868260:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868271:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868290:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb44297d800) 00010000:00010000:3.0:1782487584.868301:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.868308:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.868317:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b859871 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871088:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871102:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871115:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871125:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.871131:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871148:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871163:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4c5b3dc00) 00010000:00010000:3.0:1782487584.871166:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.871171:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.871178:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1800/0x66475b4e8b859894 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.871246:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212292508269 time 7212292633627 state 0x0 ref 2 00000100:00100000:3.0:1782487584.871275:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+906:294154:x1869066294176000:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.871288:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.872347:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8598b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a476f83 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872406:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872519:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872532:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872551:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872637:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872653:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872811:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872823:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872831:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487584.872864:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xac9:0x0]: returning size 0 00000004:00200000:3.0:1782487584.872869:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487584.872886:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872908:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872927:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872946:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872954:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.872985:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.872996:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873004:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873018:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.873023:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.873028:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873033:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b8598b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873046:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873059:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873065:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873080:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.873083:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873087:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873157:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb562461e00) 00010000:00010000:3.0:1782487584.873163:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.873168:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873184:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b8598be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873225:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b8598b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f83 expref: 912 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873252:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b8598e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xac9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f83 expref: 910 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.873261:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb44a127c00) 00010000:00010000:3.0:1782487584.873266:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.873270:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb576a0c800, rc 0) 00000100:00100000:3.0:1782487584.873308:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+910:294154:x1869066294176000:12345-192.168.202.21@tcp:101:rm.500 Request processed in 2043us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.873316:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26503 00000100:00100000:3.0:1782487584.873731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.874044:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.874051:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b859919 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.874064:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.874069:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b859919 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.874091:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b859919 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.874113:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb09:0x0].0x0 (ffff9cb5588eec00) 00010000:00010000:3.0:1782487584.874120:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.874124:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b859919 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.874135:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b859919 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.874152:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.874156:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.874160:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487584.876723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.876774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.876849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.876930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.877035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.877069:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877081:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877129:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877142:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.877147:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877156:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877169:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xace:0x0].0x0 (ffff9cb442727b00) 00010000:00010000:3.0:1782487584.877172:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.877188:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877199:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b8598a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xace:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877245:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877257:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877266:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877273:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb0800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.877280:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877296:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877310:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb5588eea00) 00010000:00010000:3.0:1782487584.877314:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.877317:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.877335:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb0800/0x66475b4e8b8598e1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.878851:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.879041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.879129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.879172:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294177664 00000100:00100000:3.0:1782487584.879324:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294177664 00000100:00100000:3.0:1782487584.879392:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16002 00000100:00100000:3.0:1782487584.879413:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+65:2360:x1869066294177664:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487584.879428:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.879447:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47700f expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487584.879468:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1845:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487584.879485:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487584.879490:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487584.879508:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 66 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.879537:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 66 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.879555:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d400, rc 0) 00000100:00100000:3.0:1782487584.879728:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+66:2360:x1869066294177664:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 323us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.879740:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16002 00000100:00100000:3.0:1782487584.879778:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294177920 00000100:00100000:3.0:1782487584.879784:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294177920 00000100:00100000:3.0:1782487584.879840:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294178176 00000100:00100000:3.0:1782487584.879848:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294178176 00000100:00100000:3.0:1782487584.879911:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16004 00000100:00100000:3.0:1782487584.879932:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+67:2360:x1869066294178176:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487584.879944:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.879963:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47702b expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487584.880895:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1847:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782487584.880927:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487584.880933:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487584.881252:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 68 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881284:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 68 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881306:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1800, rc 0) 00000100:00100000:3.0:1782487584.881362:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+68:2360:x1869066294178176:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 1438us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.881444:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16004 00010000:00010000:3.0:1782487584.881479:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881488:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881495:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881501:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.881504:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881511:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881526:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb49de08a00) 00010000:00010000:3.0:1782487584.881530:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.881535:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.881541:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b8599e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.883578:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294178816 00000100:00100000:3.0:1782487584.883587:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294178816 00000100:00100000:3.0:1782487584.883641:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212303961740 time 7212303861740 state 0x1 ref 2 00000100:00100000:3.0:1782487584.883671:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212303961740 time 7212305060065 state 0x0 ref 2 00000100:00100000:3.0:1782487584.883687:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+531:294124:x1869066294178816:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.883731:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487584.883757:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b8591e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476da0 expref: 531 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.883788:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455051600/0x66475b4e8b858f4f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb08:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ce3 expref: 530 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.883809:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb08:0x0].0x0 (ffff9cb4b4027f00) 00010000:00010000:3.0:1782487584.883825:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.883842:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.883864:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.883978:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884106:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884117:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884131:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884328:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884338:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884351:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884602:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884630:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884637:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884643:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.884646:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884653:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884663:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb558966800) 00010000:00010000:3.0:1782487584.884667:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.884671:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.884678:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b859a7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487584.885126:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2489, 64 off167488 00010000:00010000:3.0:1782487584.885256:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885272:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885281:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885289:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885295:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885300:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885319:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.885337:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885344:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885351:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885359:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.885366:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885375:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885474:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb08:0x0].0x0 (ffff9cb44a697c00) 00010000:00010000:3.0:1782487584.885477:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.885481:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885488:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859aa1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885519:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885527:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885534:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885541:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.885545:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885552:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885565:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.885568:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.885572:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.885578:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859a93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.885598:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027588729 reply state 00000000136832fe transno 8589956487 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.885657:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.885737:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+531:294124:x1869066294178816:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2050us (2196us total) trans 8589956487 rc 0/0 00000100:00100000:3.0:1782487584.885751:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26509 00000100:00100000:3.0:1782487584.885761:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212303961740 time 7212305060065 state 0x2 ref 0 00010000:00010000:3.0:1782487584.886526:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886539:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886546:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886553:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.886558:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886566:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886579:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb562461e00) 00010000:00010000:3.0:1782487584.886582:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.886587:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.886597:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859a9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.887071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.888696:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.888702:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b859ac4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.888729:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb540031800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.888738:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b859ac4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.888763:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b859ac4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.889016:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb0b:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:3.0:1782487584.889020:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.889025:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b859ac4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.889031:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb540031800/0x66475b4e8b859ac4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.889054:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.889058:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.889060:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487584.889135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.891624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.893368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.893448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.893775:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212315235109 time 7212315135109 state 0x1 ref 3 00000100:00100000:3.0:1782487584.898991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.899455:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294180864 00000100:00100000:3.0:1782487584.899462:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294180864 00000100:00100000:3.0:1782487584.899500:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212315313857 time 7212315213857 state 0x1 ref 4 00000100:00100000:3.0:1782487584.899519:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212321008894 time 7212320908894 state 0x1 ref 5 00000100:00100000:3.0:1782487584.899540:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+926:294161:x1869066294180480:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.899565:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.899588:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b859b34 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xacf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477040 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.899680:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b859b34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xacf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477040 expref: 930 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.899699:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b859b34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xacf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477040 expref: 930 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.899728:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacf:0x0].0x0 (ffff9cb44a697c00) 00010000:00010000:3.0:1782487584.899733:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487584.899737:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d600, rc 0) 00000100:00100000:3.0:1782487584.899814:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+930:294161:x1869066294180480:12345-192.168.202.21@tcp:101:touch.500 Request processed in 279us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.899836:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26515 00000100:00100000:3.0:1782487584.899904:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212321393262 time 7212321293262 state 0x1 ref 6 00000100:00100000:3.0:1782487584.899925:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+929:294157:x1869066294181120:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487584.899959:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.899981:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b859b26 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xad0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477039 expref: 929 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900008:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad0:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487584.900020:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.900085:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859b5e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900102:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900116:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.900324:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000875a64f1 reply state 00000000bf3d0822 transno 8589956493 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859b5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.900340:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.900730:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+929:294157:x1869066294181120:12345-192.168.202.21@tcp:36:touch.500 Request processed in 807us (1602us total) trans 8589956493 rc 0/0 00000100:00100000:3.0:1782487584.900744:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26517 00000100:00100000:3.0:1782487584.900784:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212322273925 time 7212322173925 state 0x1 ref 5 00000100:00100000:3.0:1782487584.900800:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+928:294167:x1869066294181248:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.900809:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.900824:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b859b88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47704e expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900864:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900880:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900892:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900916:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900928:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.900946:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901140:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901153:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901161:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487584.901181:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xacc:0x0]: returning size 0 00000004:00200000:3.0:1782487584.901189:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487584.901207:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901233:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901244:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901260:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901279:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901298:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.901304:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901328:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901360:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.901365:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.901369:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901381:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b859b8f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901396:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901418:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901437:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901457:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.901463:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901485:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901516:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb49de08a00) 00010000:00010000:3.0:1782487584.901525:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.901532:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901555:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b859b96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901728:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b859b88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47704e expref: 930 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901773:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47704e expref: 929 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.901788:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacc:0x0].0x0 (ffff9cb44297df00) 00010000:00010000:3.0:1782487584.901792:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.901796:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467571000, rc 0) 00000100:00100000:3.0:1782487584.901868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.902025:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294181760 00000100:00100000:3.0:1782487584.902034:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294181760 00000100:00100000:3.0:1782487584.902141:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16006 00000100:00100000:3.0:1782487584.902160:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+166:2360:x1869066294181760:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487584.902684:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+167:2360:x1869066294181760:12345-192.168.202.21@tcp:2:touch.500 Request processed in 529us (818us total) trans 8589939956 rc 0/0 00000100:00100000:3.0:1782487584.902701:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16006 00000100:00100000:3.0:1782487584.902833:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+928:294167:x1869066294181248:12345-192.168.202.21@tcp:101:rm.500 Request processed in 2035us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.902858:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26519 00000100:00100000:3.0:1782487584.902866:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212322670214 time 7212323344160 state 0x2 ref 0 00000100:00100000:3.0:1782487584.904107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.912078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.912155:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294182784 00000100:00100000:3.0:1782487584.912162:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294182784 00000100:00100000:3.0:1782487584.912290:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1137 00000100:00100000:3.0:1782487584.912309:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+928:2363:x1869066294182784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487584.912324:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.912348:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b859b9d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47704e expref: 928 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.912371:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacc:0x0].0x0 (ffff9cb44297df00) 00010000:00010000:3.0:1782487584.912377:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487584.912543:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+927:2363:x1869066294182784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 240us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.912561:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1137 00000100:00100000:3.0:1782487584.913243:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294183168 00000100:00100000:3.0:1782487584.913248:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294183168 00000100:00100000:3.0:1782487584.913304:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1138 00000100:00100000:3.0:1782487584.913320:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+925:2362:x1869066294183168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487584.913328:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.913345:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b859bc0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477055 expref: 925 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.913367:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacd:0x0].0x0 (ffff9cb4c4862d00) 00010000:00010000:3.0:1782487584.913380:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487584.913439:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+924:2362:x1869066294183168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.913450:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1138 00000040:00080000:3.0:1782487584.913845:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2491, 64 off167616 00010000:00010000:3.0:1782487584.914202:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914228:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914237:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914247:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914254:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914261:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b859c14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xac9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914288:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.914306:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914314:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914325:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914333:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.914339:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914352:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914712:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xac9:0x0].0x0 (ffff9cb44297d600) 00010000:00010000:3.0:1782487584.914716:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.914777:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914785:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c0d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xac9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914820:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914831:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914840:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914849:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.914853:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914864:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914879:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.914883:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.914889:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.914897:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859bff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.914916:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096effa78 reply state 0000000099efb5c9 transno 8589956496 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.914994:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.915075:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+925:294154:x1869066294183040:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2263us (2382us total) trans 8589956496 rc 0/0 00000100:00100000:3.0:1782487584.915095:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26524 00010000:00010000:3.0:1782487584.916253:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916266:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916274:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916280:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.916285:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916294:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916311:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb44297d200) 00010000:00010000:3.0:1782487584.916315:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.916319:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.916327:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b859c06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.917541:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294183808 00000100:00100000:3.0:1782487584.917549:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294183808 00000100:00100000:3.0:1782487584.917592:0:190298:0:(nrs_tbf.c:478:nrs_tbf_cli_fini()) unknown.0 NRS: TBF class fini: class@ffff9cb54371a000 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 3 deadline 0 time 7212338979505 state 0x4 ref 0 00000100:00100000:3.0:1782487584.917748:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212339179234 time 7212339079234 state 0x1 ref 2 00000100:00100000:3.0:1782487584.917812:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212339179234 time 7212339201670 state 0x0 ref 2 00000100:00100000:3.0:1782487584.917836:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+925:294170:x1869066294183808:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.917852:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.917869:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859c22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477071 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918065:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918084:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918106:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918127:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859c3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918136:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859c3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.918148:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859c3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487584.918925:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1822:0x0], index 1: 0 00010000:00010000:3.0:1782487584.919196:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b859c4c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919208:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b859c4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919231:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b859c4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919276:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919282:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919288:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919302:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.919306:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919322:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919338:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.919345:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.919352:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919368:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b859c37 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.919404:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfef14d4 reply state 00000000effdb1ea transno 8589956499 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b859c3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.919412:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.919449:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b859c22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477071 expref: 928 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919474:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b859c4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477071 expref: 927 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.919484:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad1:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487584.919488:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.919494:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56da25200, rc 0) 00000100:00100000:3.0:1782487584.919593:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+928:294170:x1869066294183808:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1767us (2209us total) trans 8589956499 rc 0/0 00000100:00100000:3.0:1782487584.919646:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26526 00000100:00100000:3.0:1782487584.921842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.921908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.921972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.922311:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212343579295 time 7212343698352 state 0x0 ref 3 00000100:00100000:3.0:1782487584.922340:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+927:294169:x1869066294184832:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.922354:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.922373:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477078 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922562:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922574:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922587:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922655:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859c84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922667:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859c84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.922681:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859c84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487584.923753:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1849:0x0], index 0: 0 00010000:00010000:3.0:1782487584.923991:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859c99 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924004:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924025:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924379:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924393:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924399:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924410:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.924418:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924447:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924469:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.924473:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.924479:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924490:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859c7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.924523:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f11de4f reply state 00000000264875dc transno 8589956503 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859c84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.924536:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.924571:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859c68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477078 expref: 931 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924598:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859c99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477078 expref: 930 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.924701:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad2:0x0].0x0 (ffff9cb5588eea00) 00010000:00010000:3.0:1782487584.924706:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.924712:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07a00, rc 0) 00000100:00100000:3.0:1782487584.924784:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+931:294169:x1869066294184832:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2453us (2814us total) trans 8589956503 rc 0/0 00000100:00100000:3.0:1782487584.924958:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26529 00010000:00010000:3.0:1782487584.929819:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929829:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929835:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929840:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.929844:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929851:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929862:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487584.929867:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.929883:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.929890:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859c6f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.930424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.930806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.931793:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.931803:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859cca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.931820:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.931825:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859cca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.931843:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859cca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934445:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb11:0x0].0x0 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487584.934450:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.934456:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859cca lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934465:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859cca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934498:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.934504:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.934513:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.934674:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934682:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934691:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934699:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.934703:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934711:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934727:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad2:0x0].0x0 (ffff9cb4b4027600) 00010000:00010000:3.0:1782487584.934731:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.934736:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934747:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859cae lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.934789:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294185728 00000100:00100000:3.0:1782487584.934794:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294185728 00000100:00100000:3.0:1782487584.934821:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212351562995 time 7212352226871 state 0x0 ref 1 00000100:00100000:3.0:1782487584.934844:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212352326871 time 7212352226871 state 0x1 ref 2 00000100:00100000:3.0:1782487584.934883:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212356352914 time 7212356271758 state 0x0 ref 2 00000100:00100000:3.0:1782487584.934912:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+933:294169:x1869066294185728:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.934925:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.934947:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b859cd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477086 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.934993:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b859cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477086 expref: 935 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.935014:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b859cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477086 expref: 935 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.935040:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad2:0x0].0x0 (ffff9cb5588eec00) 00010000:00010000:3.0:1782487584.935045:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487584.935049:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd06a00, rc 0) 00000100:00100000:3.0:1782487584.935088:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+934:294169:x1869066294185728:12345-192.168.202.21@tcp:101:touch.500 Request processed in 183us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.935107:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26534 00000100:00100000:3.0:1782487584.938393:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294186368 00000100:00100000:3.0:1782487584.938406:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294186368 00000100:00100000:3.0:1782487584.938525:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16009 00000100:00100000:3.0:1782487584.938538:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+70:2362:x1869066294186368:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487584.938995:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb575f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+71:2362:x1869066294186368:12345-192.168.202.21@tcp:2:touch.500 Request processed in 458us (2492us total) trans 8589940620 rc 0/0 00000100:00100000:3.0:1782487584.939006:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16009 00010000:00010000:3.0:1782487584.939387:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939400:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939409:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939417:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.939425:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939434:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939457:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb49de08a00) 00010000:00010000:3.0:1782487584.939461:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.939466:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.939474:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446800/0x66475b4e8b859ce6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.943175:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212364059319 time 7212364562267 state 0x0 ref 2 00000100:00100000:3.0:1782487584.943197:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+937:294177:x1869066294187136:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.943227:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.943247:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859d02 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477094 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943395:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943409:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943420:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943437:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859d10 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943446:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859d10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.943455:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859d10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487584.944230:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x184a:0x0], index 0: 0 00010000:00010000:3.0:1782487584.944457:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859d17 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944470:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944481:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944526:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944534:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944542:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944550:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.944556:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944566:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944587:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.944591:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.944597:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944639:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859d09 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.944657:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ed4ccbf reply state 000000000bb35a3a transno 8589956510 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859d10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.944668:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.944707:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859d02 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477094 expref: 939 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944730:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859d17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477094 expref: 938 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.944738:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad4:0x0].0x0 (ffff9cb5588ee800) 00010000:00010000:3.0:1782487584.944741:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.944746:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551527c00, rc 0) 00000100:00100000:3.0:1782487584.944816:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+939:294177:x1869066294187136:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1625us (2468us total) trans 8589956510 rc 0/0 00000100:00100000:3.0:1782487584.944827:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26536 00000100:00100000:3.0:1782487584.948314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.949932:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294187776 00000100:00100000:3.0:1782487584.949940:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294187776 00000100:00100000:3.0:1782487584.949979:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212368774552 time 7212369880605 state 0x0 ref 1 00000100:00100000:3.0:1782487584.949990:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212369980605 time 7212369880605 state 0x1 ref 1 00000100:00100000:3.0:1782487584.950018:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212369980605 time 7212371409135 state 0x0 ref 1 00000100:00100000:3.0:1782487584.950031:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+939:294160:x1869066294187776:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.950127:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487584.950157:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85999e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476fc9 expref: 939 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950183:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b859912 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f91 expref: 938 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950208:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859808 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xacb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f60 expref: 937 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950237:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacb:0x0].0x0 (ffff9cb4c5b3df00) 00010000:00010000:3.0:1782487584.950263:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.950289:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950303:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950314:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950335:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950347:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950356:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950518:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950528:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.950536:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487584.951380:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2494, 64 off167808 00010000:00010000:3.0:1782487584.951511:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951520:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951527:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951534:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951539:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951543:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859d48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951565:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487584.951589:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951598:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951632:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951648:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.951655:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951666:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951696:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacb:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487584.951700:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.951704:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951711:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7600/0x66475b4e8b859d41 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xacb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951750:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951760:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951771:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951778:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.951782:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951790:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951807:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.951811:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.951816:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.951834:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859d33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.951858:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f506dc3 reply state 00000000cdacefee transno 8589956512 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.951878:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.951981:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+937:294160:x1869066294187776:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1948us (2326us total) trans 8589956512 rc 0/0 00000100:00100000:3.0:1782487584.951994:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26539 00000100:00100000:3.0:1782487584.952003:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212369980605 time 7212371409135 state 0x2 ref 0 00000100:00100000:3.0:1782487584.952039:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294187904 00000100:00100000:3.0:1782487584.952045:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294187904 00000100:00100000:3.0:1782487584.952072:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212369980605 time 7212371409135 state 0x0 ref 1 00000100:00100000:3.0:1782487584.952085:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212371509135 time 7212371409135 state 0x1 ref 1 00000100:00100000:3.0:1782487584.952123:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212371509135 time 7212373510840 state 0x0 ref 1 00000100:00100000:3.0:1782487584.952141:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+937:294177:x1869066294187904:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.952154:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.952175:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859d4f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4770a2 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.952236:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859d4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770a2 expref: 938 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.952250:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b859d4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770a2 expref: 938 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.952275:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad4:0x0].0x0 (ffff9cb4b4027600) 00010000:00010000:3.0:1782487584.952527:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487584.952532:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481000, rc 0) 00000100:00100000:3.0:1782487584.952576:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+938:294177:x1869066294187904:12345-192.168.202.21@tcp:101:touch.500 Request processed in 440us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487584.952669:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26540 00000100:00100000:3.0:1782487584.952676:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212371509135 time 7212373510840 state 0x2 ref 0 00010000:00010000:3.0:1782487584.953349:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953361:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953369:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953376:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.953546:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953557:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953574:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb49de08a00) 00010000:00010000:3.0:1782487584.953577:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.953583:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.953590:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b859d3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.955491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.955655:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.957578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.957994:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958006:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958016:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958032:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474400a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.958042:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958051:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958066:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb44297d100) 00010000:00010000:3.0:1782487584.958070:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.958075:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.958082:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b859d5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.958678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487584.961128:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.961140:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859d87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.961161:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.961169:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859d87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.961187:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859d87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.961223:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacc:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487584.961231:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.961239:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859d87 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.961248:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859d87 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xacc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.961277:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.961282:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.961287:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487584.963835:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294189440 00000100:00100000:3.0:1782487584.963846:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294189440 00000100:00100000:3.0:1782487584.964117:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1114 00000100:00100000:3.0:1782487584.964143:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+937:2360:x1869066294189440:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487584.964182:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.964202:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859da3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4770b0 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964266:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964281:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964297:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964317:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964325:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964360:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964443:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964468:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964474:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964480:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.964489:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964518:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964556:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.964568:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.964574:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964581:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859daa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964643:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964653:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964662:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964716:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.964727:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964747:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964791:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487584.964800:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.964805:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964876:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859db1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.964980:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859da3 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b0 expref: 938 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.965017:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.965024:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487584.965042:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859da3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b0 expref: 938 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.965060:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07c00, rc -2) 00000100:00100000:3.0:1782487584.965125:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+936:2360:x1869066294189440:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 990us (1487us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487584.965188:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1114 00000100:00100000:3.0:1782487584.968935:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294189696 00000100:00100000:3.0:1782487584.968947:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294189696 00000100:00100000:3.0:1782487584.969005:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212380300141 time 7212385334598 state 0x0 ref 1 00000100:00100000:3.0:1782487584.969068:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212385434598 time 7212385334598 state 0x1 ref 1 00000100:00100000:3.0:1782487584.969122:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212385434598 time 7212390509188 state 0x0 ref 1 00000100:00100000:3.0:1782487584.969146:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+936:294171:x1869066294189696:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487584.969239:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487584.969279:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859a3f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476fd7 expref: 936 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969326:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b859951 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xacd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f9f expref: 935 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969357:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b859886 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xacd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f7c expref: 934 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969382:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacd:0x0].0x0 (ffff9cb4c4862d00) 00010000:00010000:3.0:1782487584.969399:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.969430:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859dc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969450:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969467:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969487:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969511:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969521:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969786:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859dd4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xacd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969797:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xacd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.969808:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xacd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971549:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487584.971558:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859ddb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971567:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487584.971571:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859ddb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971580:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859ddb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971599:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacd:0x0].0x0 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487584.971602:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487584.971641:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859ddb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971649:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b859ddb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xacd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.971754:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.971758:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.971763:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487584.977365:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977383:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977390:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977397:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.977402:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977408:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977433:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487584.977437:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.977442:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.977450:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859dcd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.982363:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294190336 00000100:00100000:3.0:1782487584.982377:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294190336 00000100:00100000:3.0:1782487584.982427:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212390609188 time 7212399487752 state 0x0 ref 1 00000100:00100000:3.0:1782487584.982444:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212399587752 time 7212399487752 state 0x1 ref 1 00000100:00100000:3.0:1782487584.982539:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212399587752 time 7212403926218 state 0x0 ref 1 00000100:00100000:3.0:1782487584.982568:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4551b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+937:294181:x1869066294190336:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487584.982683:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487584.982720:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b859df7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xad5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770be expref: 938 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.982749:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad5:0x0].0x0 (ffff9cb44297dd00) 00010000:00010000:3.0:1782487584.982767:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487584.982871:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.982887:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.982923:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.983123:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c89a525 reply state 00000000fbdb3927 transno 8589956519 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.983140:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487584.983280:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4551b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+939:294181:x1869066294190336:12345-192.168.202.21@tcp:36:touch.500 Request processed in 721us (1067us total) trans 8589956519 rc 0/0 00000100:00100000:3.0:1782487584.983293:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26546 00010000:00010000:3.0:1782487584.985331:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985345:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985351:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985356:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.985360:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985373:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985394:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad5:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487584.985397:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.985401:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.985406:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b859e13 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.986596:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294191232 00000100:00100000:3.0:1782487584.986643:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294191232 00000100:00100000:3.0:1782487584.986699:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212408172296 time 7212408072296 state 0x1 ref 2 00000100:00100000:3.0:1782487584.986752:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212408172296 time 7212408141234 state 0x0 ref 2 00000100:00100000:3.0:1782487584.986777:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+940:294182:x1869066294191232:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487584.986802:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.986825:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859e36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4770d3 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987026:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987039:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987061:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987090:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987098:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.987108:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487584.989189:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1825:0x0], index 1: 0 00010000:00010000:3.0:1782487584.990300:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e59 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990320:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990352:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990410:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990444:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990466:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990475:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.990481:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990489:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990506:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487584.990510:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.990515:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990523:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b859e44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487584.990590:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a15a0130 reply state 00000000aedc48a7 transno 8589956522 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.990603:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487584.990687:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07c00/0x66475b4e8b859e36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770d3 expref: 943 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990710:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770d3 expref: 942 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.990719:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad7:0x0].0x0 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487584.990721:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487584.990725:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611000, rc 0) 00010000:00010000:3.0:1782487584.993683:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.993703:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.993733:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.993745:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.993757:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.993768:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.993884:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487584.994050:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.994060:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.994071:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b859e4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995574:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995662:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995683:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995694:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487584.995700:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995709:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995780:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad7:0x0].0x0 (ffff9cb486c9ae00) 00010000:00010000:3.0:1782487584.995784:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487584.995789:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.995796:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b859e67 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487584.996551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.996648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487584.999486:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212420971086 time 7212420871086 state 0x1 ref 5 00000100:00100000:3.0:1782487584.999597:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+951:294195:x1869066294193024:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487584.999662:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487584.999691:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859e98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4770ef expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999771:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999797:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999811:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999833:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999844:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487584.999855:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000034:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000047:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000063:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.000098:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xad2:0x0]: returning size 0 00000004:00200000:3.0:1782487585.000104:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.000126:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000148:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000159:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000167:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000175:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000182:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558611000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.000188:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000197:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000229:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.000235:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.000241:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000255:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611000/0x66475b4e8b859e9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000282:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000289:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000298:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000305:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551527c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.000310:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000318:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000343:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487585.000348:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.000353:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000360:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551527c00/0x66475b4e8b859ea6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000417:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558611200/0x66475b4e8b859e98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770ef expref: 953 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000519:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b859eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770ef expref: 954 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.000531:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad2:0x0].0x0 (ffff9cb5588eec00) 00010000:00010000:3.0:1782487585.000537:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.000544:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d5535e00, rc 0) 00000100:00100000:3.0:1782487585.000585:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294193920 00000100:00100000:3.0:1782487585.000594:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294193920 00000100:00100000:3.0:1782487585.000719:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16015 00000100:00100000:3.0:1782487585.000751:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+170:2361:x1869066294193920:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.003602:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+171:2361:x1869066294193920:12345-192.168.202.21@tcp:2:touch.500 Request processed in 2869us (3203us total) trans 8589939960 rc 0/0 00000100:00100000:3.0:1782487585.003647:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16015 00000100:00080000:3.0:1782487585.003702:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782487585.003710:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782487585.003800:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4421dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+954:294195:x1869066294193024:12345-192.168.202.21@tcp:101:rm.500 Request processed in 4220us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.003812:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26555 00000100:00100000:3.0:1782487585.003821:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212423043641 time 7212423359812 state 0x2 ref 0 00000100:00080000:3.0:1782487585.007012:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487585.007426:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294195072 00000100:00100000:3.0:1782487585.007435:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294195072 00000100:00100000:3.0:1782487585.007471:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212423459812 time 7212425429513 state 0x0 ref 1 00000100:00100000:3.0:1782487585.007485:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212425529513 time 7212425429513 state 0x1 ref 1 00000100:00100000:3.0:1782487585.007560:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212425529513 time 7212428949512 state 0x0 ref 1 00000100:00100000:3.0:1782487585.007576:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+954:294190:x1869066294195072:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.007588:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.007635:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859f71 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47713c expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007878:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007892:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007906:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007925:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007933:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.007942:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.008885:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1826:0x0], index 1: 0 00010000:00010000:3.0:1782487585.009131:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b859f86 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009142:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b859f86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009152:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b859f86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009194:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009202:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009208:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009227:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.009231:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009237:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009253:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.009258:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.009264:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009272:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859f78 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.009295:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0b26094 reply state 00000000effdb1ea transno 8589956529 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.009305:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.009351:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859f71 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47713c expref: 958 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009376:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b859f86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47713c expref: 957 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.009386:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad9:0x0].0x0 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487585.009390:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.009394:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00000100:00100000:3.0:1782487585.009447:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+958:294190:x1869066294195072:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1873us (2067us total) trans 8589956529 rc 0/0 00000100:00100000:3.0:1782487585.009461:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26562 00000100:00100000:3.0:1782487585.009473:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212425529513 time 7212428949512 state 0x2 ref 0 00010000:00010000:3.0:1782487585.010699:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010715:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010723:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010731:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.010736:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010745:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010765:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487585.010770:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.010775:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.010783:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859f7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.012302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.012395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.012471:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212429049512 time 7212433858273 state 0x0 ref 1 00000100:00100000:3.0:1782487585.012493:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+960:294190:x1869066294195840:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.012532:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.012569:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b859f86 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47713c expref: 960 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.012594:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad9:0x0].0x0 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487585.012631:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.012714:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b859f9b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.012729:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b859f9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.012742:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b859f9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.012852:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6a7ab13 reply state 00000000264875dc transno 8589956531 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b859f9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.012875:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.012938:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+961:294190:x1869066294195840:12345-192.168.202.21@tcp:36:touch.500 Request processed in 451us (635us total) trans 8589956531 rc 0/0 00000100:00100000:3.0:1782487585.012951:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26563 00000100:00100000:3.0:1782487585.014964:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294196224 00000100:00100000:3.0:1782487585.014975:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294196224 00000100:00100000:3.0:1782487585.015019:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212433958273 time 7212433907598 state 0x0 ref 1 00000100:00100000:3.0:1782487585.015034:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212434007598 time 7212433907598 state 0x1 ref 1 00000100:00100000:3.0:1782487585.015074:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212434007598 time 7212436462829 state 0x0 ref 1 00000100:00100000:3.0:1782487585.015093:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+961:294190:x1869066294196224:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.015115:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.015136:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b859fbe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477151 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.015192:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b859fbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477151 expref: 962 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.015206:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b859fbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477151 expref: 962 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.015233:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad9:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.015236:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.015239:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4da00, rc 0) 00000100:00100000:3.0:1782487585.015288:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+962:294190:x1869066294196224:12345-192.168.202.21@tcp:101:touch.500 Request processed in 201us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.015299:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26565 00000100:00100000:3.0:1782487585.015305:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212434007598 time 7212436462829 state 0x2 ref 0 00000100:00100000:3.0:1782487585.016321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.016480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.016550:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.016640:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212438044120 time 7212438028226 state 0x0 ref 2 00000100:00100000:3.0:1782487585.016659:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+963:294193:x1869066294196736:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.016678:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.016700:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b859fc5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477158 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016884:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016898:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859fcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016908:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36000/0x66475b4e8b859fcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016939:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016947:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.016957:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.017694:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1827:0x0], index 1: 0 00010000:00010000:3.0:1782487585.020360:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020374:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020383:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020391:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.020398:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020406:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020428:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xada:0x0].0x0 (ffff9cb44297df00) 00010000:00010000:3.0:1782487585.020433:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.020438:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.020444:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b859fda lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.020599:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294197248 00000100:00100000:3.0:1782487585.020647:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294197248 00000100:00100000:3.0:1782487585.020725:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5681 00000100:00100000:3.0:1782487585.020746:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+966:294190:x1869066294197248:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.021264:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+966:294190:x1869066294197248:12345-192.168.202.21@tcp:35:touch.500 Request processed in 525us (773us total) trans 8589956535 rc 0/0 00000100:00100000:3.0:1782487585.021276:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5681 00010000:00010000:3.0:1782487585.023153:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023171:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023180:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023189:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.023195:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023204:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023237:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb486c9ae00) 00010000:00010000:3.0:1782487585.023242:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.023248:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.023256:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b859fd3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.024752:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212446153399 time 7212446139503 state 0x0 ref 2 00000100:00100000:3.0:1782487585.024780:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+966:294194:x1869066294197760:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.024795:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.024817:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859ff6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477166 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025000:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025014:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025024:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025043:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025051:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.025060:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.025882:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x184e:0x0], index 0: 0 00010000:00010000:3.0:1782487585.026130:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a012 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xadc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026143:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xadc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026154:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xadc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026345:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026354:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026361:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026368:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.026374:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026382:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026398:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.026401:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.026406:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026412:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a004 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.026433:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfef14d4 reply state 00000000cdacefee transno 8589956537 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.026442:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.026481:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b859ff6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477166 expref: 969 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026510:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a012 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xadc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477166 expref: 968 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026518:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadc:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487585.026521:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.026525:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00000100:00100000:3.0:1782487585.026596:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+969:294194:x1869066294197760:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1828us (2189us total) trans 8589956537 rc 0/0 00000100:00100000:3.0:1782487585.026646:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26570 00000100:00100000:3.0:1782487585.026656:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212446153399 time 7212446139503 state 0x2 ref 0 00010000:00010000:3.0:1782487585.026721:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026731:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026740:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026747:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.026753:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026764:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026783:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadb:0x0].0x0 (ffff9cb5588eea00) 00010000:00010000:3.0:1782487585.026787:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.026793:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.026800:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b859ffd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xadb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029177:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029189:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029196:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029205:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.029221:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029231:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029256:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487585.029259:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.029266:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029275:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a00b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.029411:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212448966811 time 7212450797559 state 0x0 ref 1 00000100:00100000:3.0:1782487585.029440:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+969:294194:x1869066294198272:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.029502:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.029528:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a012 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xadc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477166 expref: 970 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029552:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadc:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487585.029566:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.029691:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029704:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.029716:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.029903:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b4d69bf reply state 000000005fae1793 transno 8589956539 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.029922:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.029987:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+972:294194:x1869066294198272:12345-192.168.202.21@tcp:36:touch.500 Request processed in 559us (790us total) trans 8589956539 rc 0/0 00000100:00100000:3.0:1782487585.029998:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26572 00000100:00100000:3.0:1782487585.033955:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294199040 00000100:00100000:3.0:1782487585.033971:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294199040 00000100:00100000:3.0:1782487585.034128:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16024 00000100:00100000:3.0:1782487585.034144:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+175:2363:x1869066294199040:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.034527:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+176:2363:x1869066294199040:12345-192.168.202.21@tcp:2:touch.500 Request processed in 384us (736us total) trans 8589939962 rc 0/0 00000100:00100000:3.0:1782487585.034538:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16024 00010000:00010000:3.0:1782487585.034588:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034598:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034643:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034652:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.034658:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034666:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034688:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadc:0x0].0x0 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487585.034692:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.034697:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034703:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a027 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xadc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034735:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034742:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034751:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034757:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.034761:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034768:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034779:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb44297dd00) 00010000:00010000:3.0:1782487585.034781:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.034785:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.034793:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a035 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.038525:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294199296 00000100:00100000:3.0:1782487585.038889:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294199296 00000100:00100000:3.0:1782487585.038925:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294199168 00000100:00100000:3.0:1782487585.038932:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294199168 00000100:00100000:3.0:1782487585.038983:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212455386464 time 7212455286464 state 0x1 ref 3 00000100:00100000:3.0:1782487585.040490:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212461610450 time 7212461874588 state 0x0 ref 2 00000100:00100000:3.0:1782487585.040523:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+974:294199:x1869066294199168:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.040546:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.040571:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a089 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47717b expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040670:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a090 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040698:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a090 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040710:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a090 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040747:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a097 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040755:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.040763:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.041027:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294199808 00000100:00100000:3.0:1782487585.041036:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294199808 00000100:00100000:3.0:1782487585.041091:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16025 00000100:00100000:3.0:1782487585.041110:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2360:x1869066294199808:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.042497:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2360:x1869066294199808:12345-192.168.202.21@tcp:2:touch.500 Request processed in 1387us (1676us total) trans 8589940625 rc 0/0 00000100:00100000:3.0:1782487585.042508:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16025 00000100:00100000:3.0:1782487585.042564:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294200064 00000100:00100000:3.0:1782487585.042570:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294200064 00000100:00100000:3.0:1782487585.043975:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5683 00000100:00100000:3.0:1782487585.043997:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+975:294193:x1869066294200064:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.046897:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+976:294193:x1869066294200064:12345-192.168.202.21@tcp:35:touch.500 Request processed in 2898us (5946us total) trans 8589956541 rc 0/0 00000100:00100000:3.0:1782487585.046911:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5683 00000100:00100000:3.0:1782487585.047754:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212461974588 time 7212462436837 state 0x0 ref 1 00000100:00100000:3.0:1782487585.047765:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212462536837 time 7212462436837 state 0x1 ref 1 00000100:00100000:3.0:1782487585.047791:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212462536837 time 7212469182285 state 0x0 ref 1 00000100:00100000:3.0:1782487585.047802:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+974:294202:x1869066294199296:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.047819:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.047838:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85a0c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477182 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047890:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047902:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047911:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047923:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047928:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.047939:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048081:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048090:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048099:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.048128:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xad9:0x0]: returning size 0 00000004:00200000:3.0:1782487585.048132:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.048151:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048162:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048171:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048179:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048184:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048189:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb452643200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.048192:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048198:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048208:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.048222:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.048227:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048231:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb452643200/0x66475b4e8b85a0cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048245:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048250:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048254:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048258:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.048260:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048264:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048271:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4b4027d00) 00010000:00010000:3.0:1782487585.048273:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.048275:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048280:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a0d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048316:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85a0c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477182 expref: 976 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048331:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85a0dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xad9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477182 expref: 975 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.048339:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad9:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.048341:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.048345:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb576a0c800, rc 0) 00000100:00100000:3.0:1782487585.048396:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+975:294202:x1869066294199296:12345-192.168.202.21@tcp:101:rm.500 Request processed in 595us (9975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.048405:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26579 00000100:00100000:3.0:1782487585.048411:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212462536837 time 7212469182285 state 0x2 ref 0 00000100:00100000:3.0:1782487585.049486:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294200448 00000100:00100000:3.0:1782487585.049491:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294200448 00000100:00100000:3.0:1782487585.049552:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16028 00000100:00100000:3.0:1782487585.049565:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+177:2360:x1869066294200448:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.049587:0:213693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.049637:0:213693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4771ac expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.049660:0:213693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1825:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.049684:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.049692:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.049703:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 179 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.049736:0:213693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 179 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.049761:0:213693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611200, rc 0) 00000100:00100000:3.0:1782487585.049796:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+178:2360:x1869066294200448:12345-192.168.202.21@tcp:101:rm.500 Request processed in 234us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.049806:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16028 00000100:00100000:3.0:1782487585.054428:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294200832 00000100:00100000:3.0:1782487585.054439:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294200832 00000100:00100000:3.0:1782487585.054527:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16029 00000100:00100000:3.0:1782487585.054552:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+178:2361:x1869066294200832:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.054578:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.054639:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4771b3 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.054676:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1826:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.054700:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.054706:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.054718:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 179 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.054747:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 179 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.054858:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558611000, rc 0) 00000100:00100000:3.0:1782487585.054936:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+179:2361:x1869066294200832:12345-192.168.202.21@tcp:101:rm.500 Request processed in 395us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.054947:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16029 00000100:00100000:3.0:1782487585.054976:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294201216 00000100:00100000:3.0:1782487585.054979:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294201216 00000100:00100000:3.0:1782487585.055034:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16030 00000100:00100000:3.0:1782487585.055044:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2360:x1869066294201216:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.055051:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.055064:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4771ba expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.055079:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x184b:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.055089:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.055092:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.055097:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 81 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.055109:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 81 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.055123:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551527c00, rc 0) 00000100:00100000:3.0:1782487585.055150:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2360:x1869066294201216:12345-192.168.202.21@tcp:101:rm.500 Request processed in 107us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.055160:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16030 00010000:00010000:3.0:1782487585.056463:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.056480:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a115 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.056527:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4aee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.056536:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a115 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xacf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.056579:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a115 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xacf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.056656:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xacf:0x0].0x0 (ffff9cb46022f800) 00010000:00010000:3.0:1782487585.056667:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.056680:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a115 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xacf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.056715:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a115 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xacf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.056741:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.056743:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.056745:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.059751:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059789:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059798:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059805:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.059811:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059819:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059884:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.059889:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.059895:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.059902:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a107 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061068:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.061079:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85a131 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061095:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.061101:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85a131 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061123:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85a131 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061250:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad9:0x0].0x0 (ffff9cb57f753f00) 00010000:00010000:3.0:1782487585.061259:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.061265:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85a131 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061275:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85a131 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.061295:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.061299:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.061303:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.062690:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062702:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062708:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062714:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.062718:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062725:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062738:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb57f753d00) 00010000:00010000:3.0:1782487585.062742:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.062746:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.062753:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a123 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.063400:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294201728 00000100:00100000:3.0:1782487585.063407:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294201728 00000100:00100000:3.0:1782487585.063437:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212477026166 time 7212481730176 state 0x0 ref 1 00000100:00100000:3.0:1782487585.063449:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212481830176 time 7212481730176 state 0x1 ref 1 00000100:00100000:3.0:1782487585.063478:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212481830176 time 7212484868107 state 0x0 ref 1 00000100:00100000:3.0:1782487585.063490:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+974:294187:x1869066294201728:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.063531:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.063549:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b859f08 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xad0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477104 expref: 974 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063568:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b859be3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xad0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47706a expref: 973 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063578:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad0:0x0].0x0 (ffff9cb4b4027900) 00010000:00010000:3.0:1782487585.063587:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.063604:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063756:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063766:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063783:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063790:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063798:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063901:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063910:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.063918:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.064498:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2504, 64 off168448 00010000:00010000:3.0:1782487585.064578:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064588:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064596:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064680:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064689:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064696:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a14d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064716:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.064732:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064742:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064760:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064770:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.064777:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064789:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064808:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad0:0x0].0x0 (ffff9cb544e52e00) 00010000:00010000:3.0:1782487585.064815:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.064821:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064830:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a146 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xad0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064857:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064868:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064874:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064880:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.064883:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064889:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064899:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.064902:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.064905:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.064911:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a138 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.064923:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e5084cf reply state 00000000237523f5 transno 8589956545 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.064931:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.064996:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+974:294187:x1869066294201728:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1507us (1725us total) trans 8589956545 rc 0/0 00000100:00100000:3.0:1782487585.065006:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26582 00000100:00100000:3.0:1782487585.065013:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212481830176 time 7212484868107 state 0x2 ref 0 00010000:00010000:3.0:1782487585.066710:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066726:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066737:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066744:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.066748:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066756:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066768:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb544e52700) 00010000:00010000:3.0:1782487585.066772:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.066778:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.066785:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a13f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068739:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068748:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068755:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068762:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.068766:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068782:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068794:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.068797:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.068801:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.068807:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37800/0x66475b4e8b85a15b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070139:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.070148:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a185 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070163:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.070170:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a185 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070185:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a185 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070201:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad1:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.070205:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.070209:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a185 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xad1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070249:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a185 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.070281:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.070285:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.070291:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.071736:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071747:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071754:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071760:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.071765:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071772:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071784:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb57f753800) 00010000:00010000:3.0:1782487585.071788:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.071792:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.071798:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a177 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073565:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.073575:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b85a1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073590:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.073596:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b85a1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073639:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b85a1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073662:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad2:0x0].0x0 (ffff9cb57f753700) 00010000:00010000:3.0:1782487585.073667:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.073682:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b85a1a1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073702:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401000/0x66475b4e8b85a1a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.073733:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.073738:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.073744:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.076436:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076454:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076461:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076468:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.076474:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076482:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076498:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb57f753e00) 00010000:00010000:3.0:1782487585.076502:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.076506:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.076513:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a193 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.076760:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294202624 00000100:00100000:3.0:1782487585.076769:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294202624 00000100:00100000:3.0:1782487585.076801:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212490916900 time 7212494184244 state 0x0 ref 1 00000100:00100000:3.0:1782487585.077421:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212494284244 time 7212494184244 state 0x1 ref 2 00000100:00100000:3.0:1782487585.077454:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212498922359 time 7212498843410 state 0x0 ref 2 00000100:00100000:3.0:1782487585.077471:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+970:294203:x1869066294202624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.077483:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.077496:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a1af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4771c1 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077542:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077566:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077581:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077624:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077635:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077654:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077814:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077836:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077851:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.077872:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xada:0x0]: returning size 0 00000004:00200000:3.0:1782487585.077877:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.077892:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077904:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077925:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077943:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077951:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077960:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.077966:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.077992:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078012:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.078017:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.078023:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078039:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85a1b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078065:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078084:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078097:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078111:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.078117:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078124:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078135:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb544e52700) 00010000:00010000:3.0:1782487585.078139:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.078145:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078155:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a1c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078197:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85a1af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771c1 expref: 973 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078223:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85a1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xada:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771c1 expref: 972 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.078232:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xada:0x0].0x0 (ffff9cb5588ee800) 00010000:00010000:3.0:1782487585.078237:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.078242:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551526e00, rc 0) 00000100:00100000:3.0:1782487585.078273:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+971:294203:x1869066294202624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 807us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.078281:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26587 00000100:00100000:3.0:1782487585.078287:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212498922359 time 7212498843410 state 0x2 ref 0 00000100:00100000:3.0:1782487585.080821:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294203008 00000100:00100000:3.0:1782487585.080827:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294203008 00000100:00100000:3.0:1782487585.080879:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16031 00000100:00100000:3.0:1782487585.080894:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+179:2361:x1869066294203008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.080904:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.080920:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4771d6 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.080944:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1827:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.080960:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.080968:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.080976:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 180 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.080998:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 180 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.081015:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474401000, rc 0) 00000100:00100000:3.0:1782487585.081056:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+180:2361:x1869066294203008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 165us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.081065:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16031 00000100:00100000:3.0:1782487585.084117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.084164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.085028:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.085035:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a226 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.085054:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.085060:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a226 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xad8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.085081:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a226 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.085091:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad8:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.085093:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.085095:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a226 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xad8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.085099:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a226 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xad8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.085106:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.085107:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.085109:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.087550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.095048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.095084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.095115:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294204032 00000100:00100000:3.0:1782487585.095122:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294204032 00000100:00100000:3.0:1782487585.095152:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212505798388 time 7212509080129 state 0x0 ref 1 00000100:00100000:3.0:1782487585.095164:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212509180129 time 7212509080129 state 0x1 ref 1 00000100:00100000:3.0:1782487585.095185:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212509180129 time 7212516576259 state 0x0 ref 1 00000100:00100000:3.0:1782487585.095194:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+970:294200:x1869066294204032:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.095269:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.095300:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85a0b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477197 expref: 970 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095351:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b859e91 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xad7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770e8 expref: 969 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095364:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad7:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:3.0:1782487585.095376:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.095458:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095472:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095480:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095492:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a250 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095498:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095502:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095664:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095672:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.095688:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.096260:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2501, 64 off168256 00010000:00010000:3.0:1782487585.096350:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096360:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096369:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096378:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096386:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096392:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a273 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xad7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096413:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.096433:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096444:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096457:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096464:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.096468:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096483:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096493:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xad7:0x0].0x0 (ffff9cb544e52c00) 00010000:00010000:3.0:1782487585.096497:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.096499:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096503:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af200/0x66475b4e8b85a257 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xad7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096517:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096539:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096555:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096561:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.096568:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096576:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096588:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.096591:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.096595:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.096630:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a249 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.096646:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017a8c417 reply state 0000000078c17e6e transno 8589956551 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.096654:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.096699:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+970:294200:x1869066294204032:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1505us (1659us total) trans 8589956551 rc 0/0 00000100:00100000:3.0:1782487585.096706:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26591 00000100:00100000:3.0:1782487585.096711:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212509180129 time 7212516576259 state 0x2 ref 0 00000100:00100000:3.0:1782487585.103266:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294204544 00000100:00100000:3.0:1782487585.103273:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294204544 00000100:00100000:3.0:1782487585.103313:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1117 00000100:00100000:3.0:1782487585.103325:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+970:2360:x1869066294204544:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.103355:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.103373:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a27a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477207 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103437:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103452:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103465:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103501:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103509:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103523:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103634:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103640:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103647:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103653:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.103658:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103666:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103679:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.103686:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.103691:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103707:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7a000/0x66475b4e8b85a281 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103721:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103727:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103731:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103735:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.103738:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103742:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103749:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x196d95a8 (ffff9cb46022fa00) 00010000:00010000:3.0:1782487585.103751:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.103753:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103757:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85a28f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x196d95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103780:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a27a lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477207 expref: 969 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103788:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.103791:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.103796:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a27a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477207 expref: 969 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.103807:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4aee00, rc -2) 00000100:00100000:3.0:1782487585.103873:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+968:2360:x1869066294204544:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 550us (645us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487585.103883:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1117 00010000:00010000:3.0:1782487585.117776:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.117786:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.117803:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4d600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.117810:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.117823:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.117845:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xada:0x0].0x0 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487585.117848:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.117852:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a2c0 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.117864:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a2c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xada:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.117889:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.117893:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.117899:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.121385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00080000:3.0:1782487585.155635:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782487585.159995:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160004:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160015:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160154:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d5534600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.160159:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160167:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160179:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb12:0x0].0x0 (ffff9cb57f753a00) 00010000:00010000:3.0:1782487585.160186:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.160191:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.160201:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85a322 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.160558:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294206208 00000100:00100000:3.0:1782487585.160564:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294206208 00000100:00100000:3.0:1782487585.160586:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212581496575 time 7212581396575 state 0x1 ref 2 00000100:00100000:3.0:1782487585.163079:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294206336 00000100:00100000:3.0:1782487585.163085:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294206336 00000100:00100000:3.0:1782487585.163133:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16034 00000100:00100000:3.0:1782487585.163140:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:2360:x1869066294206336:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.164222:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2360:x1869066294206336:12345-192.168.202.21@tcp:2:touch.500 Request processed in 1073us (1267us total) trans 8589939963 rc 0/0 00000100:00100000:3.0:1782487585.164231:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16034 00000100:00100000:3.0:1782487585.164852:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294206848 00000100:00100000:3.0:1782487585.164856:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294206848 00000100:00100000:3.0:1782487585.164871:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212582455077 time 7212584983191 state 0x0 ref 1 00000100:00100000:3.0:1782487585.164878:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212585083191 time 7212584983191 state 0x1 ref 1 00000100:00100000:3.0:1782487585.164895:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212585083191 time 7212586286193 state 0x0 ref 1 00000100:00100000:3.0:1782487585.164903:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+516:294220:x1869066294206848:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.164912:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.164921:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a35a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477223 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165196:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a361 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165204:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a361 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165224:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a361 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165239:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165247:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.165256:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.165872:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294207232 00000100:00100000:3.0:1782487585.165878:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294207232 00000100:00100000:3.0:1782487585.165918:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5685 00000100:00100000:3.0:1782487585.165933:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+518:294215:x1869066294207232:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.166276:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+520:294215:x1869066294207232:12345-192.168.202.21@tcp:35:touch.500 Request processed in 345us (436us total) trans 8589956560 rc 0/0 00000100:00100000:3.0:1782487585.166292:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5685 00010000:00010000:3.0:1782487585.167340:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167349:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167356:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167362:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.167367:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167374:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167385:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb46022fa00) 00010000:00010000:3.0:1782487585.167388:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.167392:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.167398:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a368 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.171839:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294207360 00000100:00100000:3.0:1782487585.171848:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294207360 00000100:00100000:3.0:1782487585.171919:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16035 00000100:00100000:3.0:1782487585.171934:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2363:x1869066294207360:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.172280:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2363:x1869066294207360:12345-192.168.202.21@tcp:2:touch.500 Request processed in 349us (590us total) trans 8589940626 rc 0/0 00000100:00100000:3.0:1782487585.172290:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16035 00000100:00100000:3.0:1782487585.175089:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294208000 00000100:00100000:3.0:1782487585.175096:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294208000 00000100:00100000:3.0:1782487585.175121:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212593466292 time 7212593756998 state 0x0 ref 1 00000100:00100000:3.0:1782487585.175133:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212593856998 time 7212593756998 state 0x1 ref 1 00000100:00100000:3.0:1782487585.175160:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212593856998 time 7212596549067 state 0x0 ref 1 00000100:00100000:3.0:1782487585.175174:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+521:294220:x1869066294208000:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.175192:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.175208:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a3ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477238 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.175270:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a3ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477238 expref: 522 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.175289:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a3ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477238 expref: 522 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.175306:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb14:0x0].0x0 (ffff9cb46022fa00) 00010000:00010000:3.0:1782487585.175310:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.175320:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00000100:00100000:3.0:1782487585.175361:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+522:294220:x1869066294208000:12345-192.168.202.21@tcp:101:touch.500 Request processed in 191us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.175370:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26605 00000100:00100000:3.0:1782487585.175375:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212593856998 time 7212596549067 state 0x2 ref 0 00000100:00100000:3.0:1782487585.175867:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294208256 00000100:00100000:3.0:1782487585.175871:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294208256 00000100:00100000:3.0:1782487585.175910:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5686 00000100:00100000:3.0:1782487585.175921:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+522:294217:x1869066294208256:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.176169:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+523:294217:x1869066294208256:12345-192.168.202.21@tcp:35:touch.500 Request processed in 250us (365us total) trans 8589956564 rc 0/0 00000100:00100000:3.0:1782487585.176179:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5686 00000100:00100000:3.0:1782487585.177260:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294208512 00000100:00100000:3.0:1782487585.177266:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294208512 00000100:00100000:3.0:1782487585.177287:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212593856998 time 7212596549067 state 0x0 ref 1 00000100:00100000:3.0:1782487585.177298:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212596649067 time 7212596549067 state 0x1 ref 1 00000100:00100000:3.0:1782487585.177336:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212596649067 time 7212598725891 state 0x0 ref 1 00000100:00100000:3.0:1782487585.177351:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+523:294218:x1869066294208512:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.177381:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.177401:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ede00/0x66475b4e8b85a3a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477231 expref: 523 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.177419:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb15:0x0].0x0 (ffff9cb5588ee800) 00010000:00010000:3.0:1782487585.177429:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.177484:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85a3b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.177496:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85a3b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.177506:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85a3b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.177592:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000136ac08f reply state 000000008a51c05d transno 8589956565 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85a3b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.177601:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.177717:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+524:294218:x1869066294208512:12345-192.168.202.21@tcp:36:touch.500 Request processed in 367us (832us total) trans 8589956565 rc 0/0 00000100:00100000:3.0:1782487585.177728:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26606 00000100:00100000:3.0:1782487585.177740:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212596649067 time 7212598725891 state 0x2 ref 0 00000100:00100000:3.0:1782487585.178499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.178630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.178676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.185297:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294209280 00000100:00100000:3.0:1782487585.185304:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294209280 00000100:00100000:3.0:1782487585.185349:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5687 00000100:00100000:3.0:1782487585.185359:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+533:294220:x1869066294209280:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.185554:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+534:294220:x1869066294209280:12345-192.168.202.21@tcp:35:touch.500 Request processed in 196us (2970us total) trans 8589956567 rc 0/0 00000100:00100000:3.0:1782487585.185564:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5687 00000100:00100000:3.0:1782487585.190843:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294210048 00000100:00100000:3.0:1782487585.190852:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294210048 00000100:00100000:3.0:1782487585.190912:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5688 00000100:00100000:3.0:1782487585.190925:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+535:294218:x1869066294210048:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.191267:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+536:294218:x1869066294210048:12345-192.168.202.21@tcp:35:touch.500 Request processed in 343us (480us total) trans 8589956568 rc 0/0 00000100:00100000:3.0:1782487585.191277:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5688 00010000:00010000:3.0:1782487585.191515:0:190303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191532:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191673:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191684:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191694:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.191720:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.191736:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191746:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x19/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191754:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191761:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191768:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191774:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.191778:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191784:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191794:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.191797:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.191801:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191807:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a44f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191824:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191831:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191836:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191842:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.191846:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191852:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191861:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb57f753700) 00010000:00010000:3.0:1782487585.191863:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.191866:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191872:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a456 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191904:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a448 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47725b expref: 537 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.191922:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x19/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47725b expref: 536 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.192204:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb16:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.192208:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1782487585.192221:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4ce00, rc 0) 00010000:00010000:3.0:1782487585.192231:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.192244:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4d600/0x66475b4e8b85a49c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477262 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.192283:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a4aa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.192304:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a4aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.192315:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a4aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.192338:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a4b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.194698:0:190303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.194708:0:190303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a4b1 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195371:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195383:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195395:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195916:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.195922:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195930:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.195954:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb57f753800) 00010000:00010000:3.0:1782487585.196017:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.196022:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a4b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196030:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196037:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a4b1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196066:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196073:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a487 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.196263:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294210688 00000100:00100000:3.0:1782487585.196272:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294210688 00000100:00100000:3.0:1782487585.196305:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212612508254 time 7212612875537 state 0x0 ref 1 00000100:00100000:3.0:1782487585.196320:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212612975537 time 7212612875537 state 0x1 ref 1 00000100:00100000:3.0:1782487585.196348:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212612975537 time 7212617737655 state 0x0 ref 1 00000100:00100000:3.0:1782487585.196412:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+537:294221:x1869066294210688:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.196431:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.196447:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85a4bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47729a expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196493:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85a4bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47729a expref: 539 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196516:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85a4bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47729a expref: 539 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.196540:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb16:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.196545:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.196551:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d9000, rc 0) 00000100:00100000:3.0:1782487585.196604:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+539:294221:x1869066294210688:12345-192.168.202.21@tcp:101:touch.500 Request processed in 199us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.196663:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26612 00000100:00100000:3.0:1782487585.207258:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294211456 00000100:00100000:3.0:1782487585.207264:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294211456 00000100:00100000:3.0:1782487585.207303:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1139 00000100:00100000:3.0:1782487585.207311:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+539:2361:x1869066294211456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.207322:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.207326:0:192468:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 66475b4e8b85a4b8) 00010000:00010000:3.0:1782487585.207329:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.207352:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+539:2361:x1869066294211456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 42us (984us total) trans 0 rc 116/116 00000100:00100000:3.0:1782487585.207359:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1139 00000100:00100000:3.0:1782487585.209319:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299217792 00000100:00100000:3.0:1782487585.209324:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299217792 00000100:00100000:3.0:1782487585.209389:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16040 00000100:00100000:3.0:1782487585.209399:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:190320:x1869066299217792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1782487585.209435:0:213228:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 6242 00000100:00100000:3.0:1782487585.215047:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294212864 00000100:00100000:3.0:1782487585.215054:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294212864 00000100:00100000:3.0:1782487585.215151:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5689 00000100:00100000:3.0:1782487585.215162:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+541:294221:x1869066294212864:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.215581:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+544:294221:x1869066294212864:12345-192.168.202.21@tcp:35:touch.500 Request processed in 419us (2937us total) trans 8589956575 rc 0/0 00000100:00100000:3.0:1782487585.215590:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5689 00000100:00100000:3.0:1782487585.217575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.217631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.217655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.217679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.218411:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212639899636 time 7212639799636 state 0x1 ref 4 00000100:00100000:3.0:1782487585.218424:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:294227:x1869066294213376:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.218453:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.218471:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a521 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772a8 expref: 547 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218486:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb19:0x0].0x0 (ffff9cb57f753700) 00010000:00010000:3.0:1782487585.218495:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.218542:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a575 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218548:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218554:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.218664:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000683f206f reply state 000000000af1576b transno 8589956576 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85a575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.218717:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.218771:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294227:x1869066294213376:12345-192.168.202.21@tcp:36:touch.500 Request processed in 350us (1141us total) trans 8589956576 rc 0/0 00000100:00100000:3.0:1782487585.218777:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26620 00000100:00100000:3.0:1782487585.218795:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212640286765 time 7212640186765 state 0x1 ref 3 00000100:00100000:3.0:1782487585.218802:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:294240:x1869066294213504:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.218809:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.218816:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a57c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4772e0 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218836:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218845:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218850:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218859:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218864:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218869:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218919:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218925:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218930:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.218942:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb15:0x0]: returning size 0 00000004:00200000:3.0:1782487585.218944:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.218951:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218956:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218965:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218972:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218978:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218984:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.218988:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.218995:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219005:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.219008:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.219012:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219017:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a583 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219027:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219031:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219035:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219039:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.219042:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219046:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219052:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4b4027000) 00010000:00010000:3.0:1782487585.219053:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.219055:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219059:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a58a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219082:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a57c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772e0 expref: 549 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219097:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85a591 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772e0 expref: 548 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219104:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb15:0x0].0x0 (ffff9cb46022f800) 00010000:00010000:3.0:1782487585.219107:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.219110:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7e00, rc 0) 00000100:00100000:3.0:1782487585.219134:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294240:x1869066294213504:12345-192.168.202.21@tcp:101:rm.500 Request processed in 331us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.219141:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26621 00000100:00100000:3.0:1782487585.219161:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212640286765 time 7212640551371 state 0x0 ref 2 00000100:00100000:3.0:1782487585.219173:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:294234:x1869066294213632:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.219181:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.219189:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85a598 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4772e7 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219492:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219502:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219511:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219524:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219531:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219539:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219909:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219920:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219929:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.219953:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb13:0x0]: returning size 0 00000004:00200000:3.0:1782487585.219956:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.219969:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219979:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219987:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.219994:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220001:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220007:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.220011:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220018:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220028:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.220031:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.220035:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220041:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a59f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220060:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220068:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220074:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220081:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.220085:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220092:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220103:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.220108:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.220111:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220117:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a5a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220146:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85a598 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772e7 expref: 548 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220166:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772e7 expref: 548 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.220178:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb13:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.220181:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.220184:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45019ac00, rc 0) 00000100:00100000:3.0:1782487585.220585:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294234:x1869066294213632:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1412us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.220594:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26622 00000100:00100000:3.0:1782487585.220599:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212640286765 time 7212640551371 state 0x2 ref 0 00000100:00100000:3.0:1782487585.222503:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.225337:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294214784 00000100:00100000:3.0:1782487585.225342:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294214784 00000100:00100000:3.0:1782487585.225379:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1141 00000100:00100000:3.0:1782487585.225388:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+547:2362:x1869066294214784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.225400:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.225419:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a5ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772e7 expref: 547 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.225434:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb13:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.225438:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.225475:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+546:2362:x1869066294214784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 89us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.225483:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1141 00000100:00100000:3.0:1782487585.225508:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294215040 00000100:00100000:3.0:1782487585.225513:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294215040 00000100:00100000:3.0:1782487585.225540:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294215296 00000100:00100000:3.0:1782487585.225544:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294215296 00000100:00100000:3.0:1782487585.225562:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5690 00000100:00100000:3.0:1782487585.225571:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294228:x1869066294215040:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.225839:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294228:x1869066294215040:12345-192.168.202.21@tcp:35:touch.500 Request processed in 268us (604us total) trans 8589956577 rc 0/0 00000100:00100000:3.0:1782487585.225849:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5690 00000100:00100000:3.0:1782487585.225869:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5691 00000100:00100000:3.0:1782487585.225877:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f72c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+548:294224:x1869066294215296:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.226026:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f72c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+549:294224:x1869066294215296:12345-192.168.202.21@tcp:35:touch.500 Request processed in 150us (752us total) trans 8589956578 rc 0/0 00000100:00100000:3.0:1782487585.226035:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5691 00000100:00100000:3.0:1782487585.234944:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294215552 00000100:00100000:3.0:1782487585.234950:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294215552 00000100:00100000:3.0:1782487585.235045:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5692 00000100:00100000:3.0:1782487585.235057:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+550:294227:x1869066294215552:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.235417:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+551:294227:x1869066294215552:12345-192.168.202.21@tcp:35:touch.500 Request processed in 361us (688us total) trans 8589956580 rc 0/0 00000100:00100000:3.0:1782487585.235427:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5692 00000100:00100000:3.0:1782487585.236658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.237377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.237673:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294216064 00000100:00100000:3.0:1782487585.237679:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294216064 00000100:00100000:3.0:1782487585.237703:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212646811524 time 7212656391603 state 0x0 ref 1 00000100:00100000:3.0:1782487585.237715:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212656491603 time 7212656391603 state 0x1 ref 1 00000100:00100000:3.0:1782487585.237736:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294216192 00000100:00100000:3.0:1782487585.237740:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294216192 00000100:00100000:3.0:1782487585.237756:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212656491603 time 7212656391603 state 0x1 ref 2 00000100:00100000:3.0:1782487585.237780:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212659270295 time 7212659170295 state 0x1 ref 2 00000100:00100000:3.0:1782487585.237793:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+552:294226:x1869066294216064:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.237831:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.237854:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85a3d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47723f expref: 552 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.237879:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85a34c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47721c expref: 551 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.237894:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb12:0x0].0x0 (ffff9cb57f753f00) 00010000:00010000:3.0:1782487585.237907:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.237927:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85a5fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.237939:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85a5fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.237949:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85a5fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.237985:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a601 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.238001:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a601 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.238017:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85a601 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.238124:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a60f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.238135:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a60f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.238144:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85a60f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241332:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.241344:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a616 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241354:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.241358:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a616 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241368:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a616 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241384:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb12:0x0].0x0 (ffff9cb44297df00) 00010000:00010000:3.0:1782487585.241388:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.241393:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a616 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241400:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a616 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.241424:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.241427:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.241430:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.241688:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294216320 00000100:00100000:3.0:1782487585.241696:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294216320 00000100:00100000:3.0:1782487585.241751:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16048 00000100:00100000:3.0:1782487585.241762:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2362:x1869066294216320:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.242179:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2362:x1869066294216320:12345-192.168.202.21@tcp:2:touch.500 Request processed in 416us (520us total) trans 8589939967 rc 0/0 00000100:00100000:3.0:1782487585.242190:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16048 00000100:00100000:3.0:1782487585.245081:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212666495912 time 7212666469148 state 0x0 ref 2 00000100:00100000:3.0:1782487585.245100:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+552:294233:x1869066294217344:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.245112:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.245126:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a640 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477311 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245239:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245251:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245260:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245277:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a655 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245286:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.245295:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.245788:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x182d:0x0], index 1: 0 00010000:00010000:3.0:1782487585.246107:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a65c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246262:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a65c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246274:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a65c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246307:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246316:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246323:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246330:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.246335:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246348:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246366:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.246370:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.246374:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.246381:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85a64e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.250252:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b88e8c3a reply state 00000000cdcf66fe transno 8589956585 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a655 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.250269:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.252308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.252643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.253101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.253185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.253226:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294218624 00000100:00100000:3.0:1782487585.253231:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294218624 00000100:00100000:3.0:1782487585.253275:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5694 00000100:00100000:3.0:1782487585.253286:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+559:294239:x1869066294218624:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.253515:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+560:294239:x1869066294218624:12345-192.168.202.21@tcp:35:touch.500 Request processed in 228us (417us total) trans 8589956588 rc 0/0 00000100:00100000:3.0:1782487585.253523:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5694 00000100:00100000:3.0:1782487585.254743:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294218368 00000100:00100000:3.0:1782487585.254749:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294218368 00000100:00100000:3.0:1782487585.254772:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212674545842 time 7212674445842 state 0x1 ref 2 00000100:00100000:3.0:1782487585.254796:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294218752 00000100:00100000:3.0:1782487585.254801:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294218752 00000100:00100000:3.0:1782487585.254820:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212674545842 time 7212674445842 state 0x1 ref 2 00000100:00100000:3.0:1782487585.254853:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212676328911 time 7212676241916 state 0x0 ref 2 00000100:00100000:3.0:1782487585.254875:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+560:294233:x1869066294218752:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.254891:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.254907:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a6a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47732d expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.254940:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47732d expref: 561 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.254953:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85a6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47732d expref: 561 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.254973:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1c:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:3.0:1782487585.254978:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.254982:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4aee00, rc 0) 00000100:00100000:3.0:1782487585.255015:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+561:294233:x1869066294218752:12345-192.168.202.21@tcp:101:touch.500 Request processed in 143us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.255032:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26635 00000100:00100000:3.0:1782487585.259652:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212681140230 time 7212681040230 state 0x1 ref 3 00000100:00100000:3.0:1782487585.259666:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+967:294262:x1869066294219264:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.259695:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.259712:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a6b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xadd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477326 expref: 967 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.259731:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadd:0x0].0x0 (ffff9cb56f8aa100) 00010000:00010000:3.0:1782487585.259740:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.259786:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a6c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xadd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.259809:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.259830:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.259953:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061defc39 reply state 00000000e4d52007 transno 8589956591 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.259964:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.260019:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+968:294262:x1869066294219264:12345-192.168.202.21@tcp:36:touch.500 Request processed in 353us (635us total) trans 8589956591 rc 0/0 00000100:00100000:3.0:1782487585.260035:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26637 00000100:00100000:3.0:1782487585.260953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.260978:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294219776 00000100:00100000:3.0:1782487585.260984:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294219776 00000100:00100000:3.0:1782487585.261039:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212681542158 time 7212681442158 state 0x1 ref 2 00000100:00100000:3.0:1782487585.261067:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212681542158 time 7212682457394 state 0x0 ref 1 00000100:00100000:3.0:1782487585.261079:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+967:294262:x1869066294219776:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.261088:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.261098:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a6f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xadd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47733b expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.261125:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xadd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47733b expref: 968 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.261136:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85a6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xadd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47733b expref: 968 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.261152:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadd:0x0].0x0 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.261154:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.261157:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae600, rc 0) 00000100:00100000:3.0:1782487585.261328:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+968:294262:x1869066294219776:12345-192.168.202.21@tcp:101:touch.500 Request processed in 251us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.261336:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26639 00000100:00100000:3.0:1782487585.261341:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212681542158 time 7212682457394 state 0x2 ref 0 00000100:00100000:3.0:1782487585.261569:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294220032 00000100:00100000:3.0:1782487585.261572:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294220032 00000100:00100000:3.0:1782487585.261663:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5695 00000100:00100000:3.0:1782487585.261673:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+563:294233:x1869066294220032:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.261824:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+564:294233:x1869066294220032:12345-192.168.202.21@tcp:35:touch.500 Request processed in 153us (369us total) trans 8589956594 rc 0/0 00000100:00100000:3.0:1782487585.261830:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5695 00010000:00010000:3.0:1782487585.262246:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262255:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262262:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262267:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.262271:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262277:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262331:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb56f8aaa00) 00010000:00010000:3.0:1782487585.262334:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.262337:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.262344:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85a6e1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.264819:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212685807757 time 7212686207640 state 0x0 ref 2 00000100:00100000:3.0:1782487585.264831:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+566:294245:x1869066294220800:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.264839:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.264851:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a70b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477349 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264938:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264949:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264957:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264968:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264975:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.264982:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.265377:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x182f:0x0], index 1: 0 00010000:00010000:3.0:1782487585.265482:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a720 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265491:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265497:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265522:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265529:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265535:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265542:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.265546:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265552:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265560:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.265563:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.265566:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265572:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a712 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.265582:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082acfbac reply state 000000009c283d00 transno 8589956596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.265588:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.265621:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a70b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477349 expref: 569 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265634:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a720 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477349 expref: 568 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.265641:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1f:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.265644:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.265647:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae800, rc 0) 00000100:00100000:3.0:1782487585.265678:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+569:294245:x1869066294220800:12345-192.168.202.21@tcp:101:touch.500 Request processed in 850us (1442us total) trans 8589956596 rc 0/0 00000100:00100000:3.0:1782487585.265686:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26642 00000100:00100000:3.0:1782487585.265710:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294221184 00000100:00100000:3.0:1782487585.265714:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294221184 00000100:00100000:3.0:1782487585.265736:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5696 00000100:00100000:3.0:1782487585.265742:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+968:294262:x1869066294221184:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.265875:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+969:294262:x1869066294221184:12345-192.168.202.21@tcp:35:touch.500 Request processed in 131us (1017us total) trans 8589956597 rc 0/0 00000100:00100000:3.0:1782487585.265881:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5696 00000100:00100000:3.0:1782487585.267536:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294221440 00000100:00100000:3.0:1782487585.267541:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294221440 00000100:00100000:3.0:1782487585.267571:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5697 00000100:00100000:3.0:1782487585.267579:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f71850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+568:294243:x1869066294221440:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.268129:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f71850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+569:294243:x1869066294221440:12345-192.168.202.21@tcp:35:touch.500 Request processed in 549us (864us total) trans 8589956598 rc 0/0 00000100:00100000:3.0:1782487585.268136:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5697 00010000:00010000:3.0:1782487585.268183:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268191:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268197:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268203:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.268206:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268225:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268235:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb49c365400) 00010000:00010000:3.0:1782487585.268238:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.268241:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268246:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85a719 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.268717:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294221824 00000100:00100000:3.0:1782487585.268722:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294221824 00000100:00100000:3.0:1782487585.268747:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212686307640 time 7212689122627 state 0x0 ref 1 00000100:00100000:3.0:1782487585.268755:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212689222627 time 7212689122627 state 0x1 ref 1 00000100:00100000:3.0:1782487585.268774:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212689222627 time 7212690165293 state 0x0 ref 1 00000100:00100000:3.0:1782487585.268784:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+568:294245:x1869066294221824:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.268809:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.268821:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a720 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477349 expref: 568 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268833:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1f:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.268840:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.268881:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a735 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268895:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a735 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.268903:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a735 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.268962:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efbdfc86 reply state 00000000315bad06 transno 8589956599 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85a735 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.268970:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.269012:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+569:294245:x1869066294221824:12345-192.168.202.21@tcp:36:touch.500 Request processed in 229us (336us total) trans 8589956599 rc 0/0 00000100:00100000:3.0:1782487585.269019:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26644 00000100:00100000:3.0:1782487585.269023:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212689222627 time 7212690165293 state 0x2 ref 0 00000100:00100000:3.0:1782487585.269372:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294222080 00000100:00100000:3.0:1782487585.269377:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294222080 00000100:00100000:3.0:1782487585.269391:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212689222627 time 7212690165293 state 0x0 ref 1 00000100:00100000:3.0:1782487585.269398:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212690265293 time 7212690165293 state 0x1 ref 1 00000100:00100000:3.0:1782487585.269422:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212690265293 time 7212690812947 state 0x0 ref 1 00000100:00100000:3.0:1782487585.269434:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+569:294247:x1869066294222080:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.269445:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.269455:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a73c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477357 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269541:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269552:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269560:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269573:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269580:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.269586:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.269966:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1856:0x0], index 0: 0 00010000:00010000:3.0:1782487585.270072:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85a751 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270081:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85a751 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270088:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85a751 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270113:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270120:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270126:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270132:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.270136:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270143:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270151:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.270153:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.270156:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270162:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a743 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.270171:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079ec0c5e reply state 000000004898f774 transno 8589956600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.270177:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.270199:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a73c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477357 expref: 572 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270227:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85a751 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477357 expref: 571 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.270235:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb20:0x0].0x0 (ffff9cb49c365e00) 00010000:00010000:3.0:1782487585.270237:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.270240:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd89400, rc 0) 00000100:00100000:3.0:1782487585.270265:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+572:294247:x1869066294222080:12345-192.168.202.21@tcp:101:touch.500 Request processed in 833us (918us total) trans 8589956600 rc 0/0 00000100:00100000:3.0:1782487585.270272:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26645 00000100:00100000:3.0:1782487585.270277:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212690265293 time 7212690812947 state 0x2 ref 0 00000100:00100000:3.0:1782487585.271039:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294222336 00000100:00100000:3.0:1782487585.271044:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294222336 00000100:00100000:3.0:1782487585.271070:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212690265293 time 7212690812947 state 0x0 ref 1 00000100:00100000:3.0:1782487585.271079:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212690912947 time 7212690812947 state 0x1 ref 1 00010000:00010000:3.0:1782487585.272873:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272883:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272889:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272895:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.272899:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272905:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272916:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.272919:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.272922:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.272929:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85a74a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.273042:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294222720 00000100:00100000:3.0:1782487585.273046:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294222720 00000100:00100000:3.0:1782487585.273074:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16054 00000100:00100000:3.0:1782487585.273080:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+79:2360:x1869066294222720:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.273276:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+80:2360:x1869066294222720:12345-192.168.202.21@tcp:2:touch.500 Request processed in 195us (289us total) trans 8589939970 rc 0/0 00000100:00100000:3.0:1782487585.273283:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16054 00000100:00100000:3.0:1782487585.273437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.275418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.276793:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294223616 00000100:00100000:3.0:1782487585.276798:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294223616 00000100:00100000:3.0:1782487585.276831:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5699 00000100:00100000:3.0:1782487585.276841:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+572:294245:x1869066294223616:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.277058:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+575:294245:x1869066294223616:12345-192.168.202.21@tcp:35:touch.500 Request processed in 216us (542us total) trans 8589956604 rc 0/0 00000100:00100000:3.0:1782487585.277067:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5699 00000100:00100000:3.0:1782487585.277088:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294223744 00000100:00100000:3.0:1782487585.277093:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294223744 00000100:00100000:3.0:1782487585.277120:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1120 00000100:00100000:3.0:1782487585.277127:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+971:2361:x1869066294223744:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.277160:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.277170:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89200/0x66475b4e8b85a7ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47736c expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277206:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277557:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277566:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277579:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277587:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.277593:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278067:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278077:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278084:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.278100:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb13:0x0]: returning size 0 00000004:00200000:3.0:1782487585.278103:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.278114:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278122:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278134:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278140:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278147:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278152:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.278155:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278161:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278168:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.278171:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.278174:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278180:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85a7b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278188:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278195:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278201:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278207:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.278221:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278227:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278235:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb49c365900) 00010000:00010000:3.0:1782487585.278237:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.278239:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278246:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a7ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278267:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89200/0x66475b4e8b85a7ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47736c expref: 972 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278278:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85a7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47736c expref: 971 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278285:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb13:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.278288:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.278290:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd88200, rc 0) 00010000:00010000:3.0:1782487585.278294:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.278301:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85a7c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477373 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278329:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a7cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278337:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a7cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278344:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a7cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278353:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278361:0:213216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278368:0:213216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278381:0:213216:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278390:0:213216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278407:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278414:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278421:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278427:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.278430:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278436:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278442:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb558966600) 00010000:00010000:3.0:1782487585.278445:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.278447:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278454:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278460:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a7d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278483:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.278489:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85a774 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.280669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.283570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.283598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.287299:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294224640 00000100:00100000:3.0:1782487585.287305:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294224640 00000100:00100000:3.0:1782487585.287334:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212698470456 time 7212700790329 state 0x0 ref 1 00000100:00100000:3.0:1782487585.287346:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212700890329 time 7212700790329 state 0x1 ref 1 00000100:00100000:3.0:1782487585.287359:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294224896 00000100:00100000:3.0:1782487585.287361:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294224896 00000100:00100000:3.0:1782487585.287369:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212700890329 time 7212700790329 state 0x1 ref 2 00000100:00100000:3.0:1782487585.287375:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294225024 00000100:00100000:3.0:1782487585.287377:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294225024 00000100:00100000:3.0:1782487585.287384:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212700890329 time 7212700790329 state 0x1 ref 3 00000100:00100000:3.0:1782487585.287390:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294225152 00000100:00100000:3.0:1782487585.287391:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294225152 00000100:00100000:3.0:1782487585.290549:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212711299603 time 7212711199603 state 0x1 ref 2 00000100:00100000:3.0:1782487585.290566:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212711299603 time 7212711957444 state 0x0 ref 2 00000100:00100000:3.0:1782487585.290575:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+576:294264:x1869066294225152:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.290583:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.290592:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a893 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4773d5 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290639:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290653:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290661:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290673:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290680:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290687:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290731:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290739:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290745:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.290760:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb1c:0x0]: returning size 0 00000004:00200000:3.0:1782487585.290763:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.290771:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290780:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290790:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290796:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290802:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290808:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.290811:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290817:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290823:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.290826:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.290828:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290834:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85a89a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290843:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290849:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290855:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290860:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.290863:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290869:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290875:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb49c365900) 00010000:00010000:3.0:1782487585.290877:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.290880:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290885:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85a8a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290903:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85a893 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773d5 expref: 578 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290912:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85a8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773d5 expref: 577 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.290919:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1c:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:3.0:1782487585.290921:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.290923:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00000100:00100000:3.0:1782487585.290945:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+577:294264:x1869066294225152:12345-192.168.202.21@tcp:101:rm.500 Request processed in 371us (3735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.290951:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26657 00000100:00100000:3.0:1782487585.291019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.291052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.291071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.291085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.291100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.291115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.294477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.294589:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.294597:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.294603:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.295285:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.295289:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.295296:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.295307:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.295309:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.295313:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.295319:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85a862 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.298704:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294226560 00000100:00100000:3.0:1782487585.298709:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294226560 00000100:00100000:3.0:1782487585.298726:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212715495604 time 7212718474773 state 0x0 ref 1 00000100:00100000:3.0:1782487585.298734:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212718574773 time 7212718474773 state 0x1 ref 1 00000100:00100000:3.0:1782487585.298757:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212718574773 time 7212720148493 state 0x0 ref 1 00000100:00100000:3.0:1782487585.298766:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+588:294263:x1869066294226560:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.298775:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.298818:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85aa30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477437 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298852:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298861:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298870:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298880:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298887:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298894:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298952:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298961:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.298968:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.298985:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb1b:0x0]: returning size 0 00000004:00200000:3.0:1782487585.298987:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.298996:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299004:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299011:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299017:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299023:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299028:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551446000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.299031:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299037:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299045:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.299047:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.299050:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299056:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85aa37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299065:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299072:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299078:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299083:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.299086:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299092:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299098:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb49c365900) 00010000:00010000:3.0:1782487585.299100:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.299103:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299109:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85aa3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299127:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85aa30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477437 expref: 590 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299137:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477437 expref: 589 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.299145:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1b:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.299147:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.299149:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551447600, rc 0) 00000100:00100000:3.0:1782487585.299173:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+589:294263:x1869066294226560:12345-192.168.202.21@tcp:101:rm.500 Request processed in 408us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.299179:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26662 00000100:00100000:3.0:1782487585.299183:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212718574773 time 7212720148493 state 0x2 ref 0 00000100:00100000:3.0:1782487585.309173:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294228608 00000100:00100000:3.0:1782487585.309178:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294228608 00000100:00100000:3.0:1782487585.309223:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294228736 00000100:00100000:3.0:1782487585.309226:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294228736 00000100:00100000:3.0:1782487585.309253:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1142 00000100:00100000:3.0:1782487585.309261:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+587:2361:x1869066294228608:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.309271:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.309284:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aa45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477437 expref: 587 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.309295:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1b:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.309299:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.309320:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+586:2361:x1869066294228608:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.309327:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1142 00000100:00100000:3.0:1782487585.309340:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1143 00000100:00100000:3.0:1782487585.309346:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+972:2361:x1869066294228736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.309352:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.309360:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587400/0x66475b4e8b85aa99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774bc expref: 972 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.309370:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb13:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.309374:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.309387:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+971:2361:x1869066294228736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 42us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.309393:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1143 00010000:00010000:3.0:1782487585.310672:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310682:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310689:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310695:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.310699:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310706:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310716:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4b6109600) 00010000:00010000:3.0:1782487585.310719:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.310723:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.310729:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85aaae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.311781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.317017:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294229376 00000100:00100000:3.0:1782487585.317024:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294229376 00000100:00100000:3.0:1782487585.317053:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212733423643 time 7212733323643 state 0x1 ref 2 00000100:00100000:3.0:1782487585.317106:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212733423643 time 7212738496419 state 0x0 ref 2 00000100:00100000:3.0:1782487585.317116:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+971:294278:x1869066294229376:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.317131:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.317145:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aadf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4774c3 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.317180:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aadf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774c3 expref: 972 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.317191:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447600/0x66475b4e8b85aadf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774c3 expref: 972 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.317227:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb13:0x0].0x0 (ffff9cb49c365900) 00010000:00010000:3.0:1782487585.317230:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.317233:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551447600, rc 0) 00000100:00100000:3.0:1782487585.317253:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+972:294278:x1869066294229376:12345-192.168.202.21@tcp:101:touch.500 Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.317262:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26667 00000100:00100000:3.0:1782487585.317267:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212733423643 time 7212738496419 state 0x2 ref 0 00000100:00100000:3.0:1782487585.322939:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294229632 00000100:00100000:3.0:1782487585.322944:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294229632 00000100:00100000:3.0:1782487585.323011:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16068 00000100:00100000:3.0:1782487585.323020:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2361:x1869066294229632:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:3.0:1782487585.323155:0:213225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x184f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782487585.323159:0:213225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x184f:0x0] updating lvb mtime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.323161:0:213225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x184f:0x0] updating lvb atime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.323164:0:213225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x184f:0x0] updating lvb ctime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.323166:0:213225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x184f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782487585.323207:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2361:x1869066294229632:12345-192.168.202.21@tcp:2:touch.500 Request processed in 189us (1772us total) trans 8589940635 rc 0/0 00000100:00100000:3.0:1782487585.323222:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16068 00010000:00010000:3.0:1782487585.324517:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324529:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324536:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324541:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.324545:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324558:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324570:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4b6109a00) 00010000:00010000:3.0:1782487585.324573:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.324576:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.324582:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85aaf4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.326177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.330365:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212751842546 time 7212751754761 state 0x0 ref 2 00000100:00100000:3.0:1782487585.330375:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+972:294287:x1869066294230016:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.330391:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.330407:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ab17 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4774d1 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330580:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330595:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330651:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330667:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ab25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330980:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ab25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.330989:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ab25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.332568:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1857:0x0], index 0: 0 00010000:00010000:3.0:1782487585.333297:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765e00/0x66475b4e8b85ab41 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xadf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333306:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765e00/0x66475b4e8b85ab41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xadf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333377:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765e00/0x66475b4e8b85ab41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xadf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333411:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333419:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333424:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333429:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.333432:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333438:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333451:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.333453:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.333456:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333461:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ab1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.333470:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088ac6837 reply state 0000000097b6506b transno 8589956614 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ab25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.333478:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.333505:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ab17 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774d1 expref: 975 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333516:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765e00/0x66475b4e8b85ab41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xadf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774d1 expref: 974 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.333522:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadf:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.333524:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.333526:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579765e00, rc 0) 00000100:00100000:3.0:1782487585.333898:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+975:294287:x1869066294230016:12345-192.168.202.21@tcp:101:touch.500 Request processed in 3523us (4192us total) trans 8589956614 rc 0/0 00000100:00100000:3.0:1782487585.333906:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26671 00000100:00100000:3.0:1782487585.333942:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294230784 00000100:00100000:3.0:1782487585.333945:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294230784 00000100:00100000:3.0:1782487585.333978:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5701 00000100:00100000:3.0:1782487585.333985:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+975:294278:x1869066294230784:12345-192.168.202.21@tcp:35:touch.500 00000004:00080000:3.0:1782487585.334168:0:190300:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0xb13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782487585.334242:0:190300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2512, 64 off168960 00010000:00010000:3.0:1782487585.334286:0:190300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334296:0:190300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334304:0:190300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334312:0:190300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334375:0:190300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334381:0:190300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765800/0x66475b4e8b85ab5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.334401:0:190300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487585.334441:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+976:294278:x1869066294230784:12345-192.168.202.21@tcp:35:touch.500 Request processed in 456us (1686us total) trans 8589956616 rc 0/0 00000100:00100000:3.0:1782487585.334448:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5701 00000100:00100000:3.0:1782487585.336379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.336837:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294231552 00000100:00100000:3.0:1782487585.336843:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294231552 00000100:00100000:3.0:1782487585.336866:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212751854761 time 7212754356593 state 0x0 ref 1 00000100:00100000:3.0:1782487585.336878:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212754456593 time 7212754356593 state 0x1 ref 1 00000100:00100000:3.0:1782487585.336897:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212754456593 time 7212758286841 state 0x0 ref 1 00000100:00100000:3.0:1782487585.336910:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+975:294287:x1869066294231552:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.336947:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.336966:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579765e00/0x66475b4e8b85ab41 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xadf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774d1 expref: 975 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.336980:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadf:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.337002:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.337054:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85ab64 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.337066:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85ab64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.337077:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85ab64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.337183:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d00c462a reply state 00000000b1b807e4 transno 8589956617 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85ab64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.337193:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.337266:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb454761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+976:294287:x1869066294231552:12345-192.168.202.21@tcp:36:touch.500 Request processed in 357us (569us total) trans 8589956617 rc 0/0 00000100:00100000:3.0:1782487585.337274:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26673 00000100:00100000:3.0:1782487585.337280:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212754456593 time 7212758286841 state 0x2 ref 0 00000100:00100000:3.0:1782487585.338456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.341511:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341525:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341533:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341542:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.341547:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341562:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341578:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb22:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.341584:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.341589:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.341600:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586800/0x66475b4e8b85ab6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.342427:0:190322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190322:1869066299218048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782487585.342477:0:190322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487585.342513:0:190322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450ececc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487585.345541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.345819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.345879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.345911:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294232320 00000100:00100000:3.0:1782487585.345917:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294232320 00000100:00100000:3.0:1782487585.345941:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212763065947 time 7212763098605 state 0x0 ref 1 00000100:00100000:3.0:1782487585.345952:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212763198605 time 7212763098605 state 0x1 ref 1 00000100:00100000:3.0:1782487585.345969:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294232960 00000100:00100000:3.0:1782487585.345973:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294232960 00000100:00100000:3.0:1782487585.346463:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212767686335 time 7212767586335 state 0x1 ref 2 00000100:00100000:3.0:1782487585.353293:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294233216 00000100:00100000:3.0:1782487585.353303:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294233216 00000100:00100000:3.0:1782487585.353347:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16072 00000100:00100000:3.0:1782487585.353356:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+85:2360:x1869066294233216:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.353626:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2360:x1869066294233216:12345-192.168.202.21@tcp:2:touch.500 Request processed in 252us (1326us total) trans 8589939972 rc 0/0 00000100:00100000:3.0:1782487585.353635:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16072 00000100:00100000:3.0:1782487585.353663:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294233472 00000100:00100000:3.0:1782487585.353667:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294233472 00000100:00100000:3.0:1782487585.353714:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5703 00000100:00100000:3.0:1782487585.353723:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+978:294287:x1869066294233472:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.353903:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+979:294287:x1869066294233472:12345-192.168.202.21@tcp:35:touch.500 Request processed in 180us (1575us total) trans 8589956624 rc 0/0 00000100:00100000:3.0:1782487585.353911:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5703 00000100:00100000:3.0:1782487585.358661:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294234240 00000100:00100000:3.0:1782487585.358665:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294234240 00000100:00100000:3.0:1782487585.358697:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212774221590 time 7212774121590 state 0x1 ref 2 00000100:00100000:3.0:1782487585.358722:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212774221590 time 7212780112276 state 0x0 ref 2 00000100:00100000:3.0:1782487585.358735:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+981:294288:x1869066294234240:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.358771:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.358787:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85abb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xae0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ed expref: 981 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.358802:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae0:0x0].0x0 (ffff9cb4b6109a00) 00010000:00010000:3.0:1782487585.358815:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.358874:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.358885:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.358895:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.359038:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a2fa58b reply state 00000000a44f5a40 transno 8589956625 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.359047:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.359109:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+982:294288:x1869066294234240:12345-192.168.202.21@tcp:36:touch.500 Request processed in 375us (1220us total) trans 8589956625 rc 0/0 00000100:00100000:3.0:1782487585.359118:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26682 00000100:00100000:3.0:1782487585.359518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.360148:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212780212276 time 7212781537705 state 0x0 ref 1 00000100:00100000:3.0:1782487585.360160:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+981:294293:x1869066294233856:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.360170:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.360181:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ac1a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477510 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360340:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360352:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360360:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360375:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360382:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360390:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360441:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360447:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360452:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360457:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.360461:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360470:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360479:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.360481:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.360484:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360489:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653d400/0x66475b4e8b85ac21 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360501:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360508:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360514:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360520:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.360524:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360531:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360540:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.360543:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.360546:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360553:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ac28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360580:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ac1a lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477510 expref: 982 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360590:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.360592:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.360596:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ac1a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477510 expref: 982 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.360872:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551446000, rc 0) 00000100:00100000:3.0:1782487585.360911:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+981:294293:x1869066294233856:12345-192.168.202.21@tcp:101:rm.500 Request processed in 752us (4307us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487585.360919:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26683 00000100:00100000:3.0:1782487585.360924:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212780212276 time 7212781537705 state 0x2 ref 0 00010000:00010000:3.0:1782487585.361530:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361539:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361546:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361551:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.361556:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361563:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361574:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae0:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.361577:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.361582:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361588:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ac13 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.361826:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294234880 00000100:00100000:3.0:1782487585.361831:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294234880 00000100:00100000:3.0:1782487585.361851:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212780212276 time 7212781537705 state 0x0 ref 1 00000100:00100000:3.0:1782487585.361861:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212781637705 time 7212781537705 state 0x1 ref 1 00000100:00100000:3.0:1782487585.361883:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212781637705 time 7212783274169 state 0x0 ref 1 00000100:00100000:3.0:1782487585.361895:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+597:294257:x1869066294234880:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.361923:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.361941:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85abe9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477509 expref: 597 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.361954:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb24:0x0].0x0 (ffff9cb546b6f500) 00010000:00010000:3.0:1782487585.361964:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.362249:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343e00/0x66475b4e8b85ac36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.362263:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343e00/0x66475b4e8b85ac36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.362273:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343e00/0x66475b4e8b85ac36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.362366:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a50dc2a2 reply state 000000002b3f4658 transno 8589956627 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343e00/0x66475b4e8b85ac36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.362374:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.362427:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+598:294257:x1869066294234880:12345-192.168.202.21@tcp:36:touch.500 Request processed in 534us (638us total) trans 8589956627 rc 0/0 00000100:00100000:3.0:1782487585.362434:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26684 00000100:00100000:3.0:1782487585.362439:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783374169 time 7212783461818 state 0x2 ref 0 00000100:00100000:3.0:1782487585.362457:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294235520 00000100:00100000:3.0:1782487585.362460:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294235520 00000100:00100000:3.0:1782487585.362473:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783374169 time 7212783461818 state 0x0 ref 1 00000100:00100000:3.0:1782487585.362479:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783561818 time 7212783461818 state 0x1 ref 1 00000100:00100000:3.0:1782487585.362491:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783561818 time 7212783882206 state 0x0 ref 1 00000100:00100000:3.0:1782487585.362501:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+598:294260:x1869066294235520:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.362510:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.362519:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ac3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477525 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.362599:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.363665:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.364092:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.364111:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.364121:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.364129:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.364923:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1833:0x0], index 1: 0 00000100:00100000:3.0:1782487585.365181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.365253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.365289:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294236160 00000100:00100000:3.0:1782487585.365296:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294236160 00000100:00100000:3.0:1782487585.365388:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783982206 time 7212783882206 state 0x1 ref 2 00000100:00100000:3.0:1782487585.365415:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294236416 00000100:00100000:3.0:1782487585.365421:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294236416 00000100:00100000:3.0:1782487585.365442:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212783982206 time 7212783882206 state 0x1 ref 3 00000100:00100000:3.0:1782487585.365469:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212786958374 time 7212786858374 state 0x1 ref 3 00000100:00100000:3.0:1782487585.365488:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+981:294292:x1869066294236160:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.365506:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.365523:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85ac52 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47752c expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365661:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365739:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365753:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365774:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365787:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365799:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365889:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85ac67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365900:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85ac67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.365907:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85ac67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.365917:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb17:0x0]: returning size 0 00010000:00010000:3.0:1782487585.366056:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366068:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366076:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366082:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.366086:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366091:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366101:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.366104:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.366108:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366113:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85ac59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366124:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366131:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366137:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366143:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.366147:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366154:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366164:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb49c365200) 00010000:00010000:3.0:1782487585.366167:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.366171:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366177:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ac60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366750:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85ac52 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47752c expref: 984 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366775:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85ac67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47752c expref: 983 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.366784:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb17:0x0].0x0 (ffff9cb4553a4000) 00010000:00010000:3.0:1782487585.366787:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.366790:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac000, rc 0) 00010000:00010000:3.0:1782487585.367396:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85ac7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367407:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85ac7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367417:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85ac7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367448:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367455:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367462:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367468:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.367472:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367479:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367490:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.367493:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.367497:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367504:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343800/0x66475b4e8b85ac44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.367516:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d316a66 reply state 0000000051d9e7ee transno 8589956630 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.367525:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.367550:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ac3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477525 expref: 602 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367569:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85ac7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477525 expref: 601 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.367577:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb25:0x0].0x0 (ffff9cb49c365400) 00010000:00010000:3.0:1782487585.367580:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.367583:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715aca00, rc 0) 00000100:00100000:3.0:1782487585.367824:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+602:294260:x1869066294235520:12345-192.168.202.21@tcp:101:touch.500 Request processed in 5323us (5460us total) trans 8589956630 rc 0/0 00000100:00100000:3.0:1782487585.367834:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26686 00000100:00100000:3.0:1782487585.367874:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+984:294292:x1869066294236160:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2392us (4175us total) trans 8589956628 rc 0/0 00000100:00100000:3.0:1782487585.367882:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26687 00000100:00100000:3.0:1782487585.367888:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212786958374 time 7212787591140 state 0x2 ref 0 00000100:00100000:3.0:1782487585.368294:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294236800 00000100:00100000:3.0:1782487585.368297:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294236800 00010000:00010000:3.0:1782487585.368948:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.368958:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.368964:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.368971:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.368974:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.368980:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.368998:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb49c365000) 00010000:00010000:3.0:1782487585.369000:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.369002:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.369007:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ac4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.371293:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294237056 00000100:00100000:3.0:1782487585.371300:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294237056 00000100:00100000:3.0:1782487585.371389:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212786958374 time 7212787591140 state 0x0 ref 1 00000100:00100000:3.0:1782487585.371400:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212787691140 time 7212787591140 state 0x1 ref 2 00000100:00100000:3.0:1782487585.371422:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294237568 00000100:00100000:3.0:1782487585.371425:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294237568 00000100:00100000:3.0:1782487585.371453:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212792917231 time 7212792817231 state 0x1 ref 3 00000100:00100000:3.0:1782487585.371473:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212792963377 time 7212792863377 state 0x1 ref 3 00000100:00100000:3.0:1782487585.371484:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+985:294292:x1869066294237312:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.371504:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.371517:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85ac67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47752c expref: 985 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.371528:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb17:0x0].0x0 (ffff9cb4553a4000) 00010000:00010000:3.0:1782487585.371532:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.371584:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.371598:0:196437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85a81c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b9 expref: 600 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.372742:0:196437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.372776:0:196437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85a81c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b9 expref: 600 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.372792:0:196437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85a81c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b9 expref: 600 pid: 213218 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.372807:0:196437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196437:1869066299218176:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487585.372871:0:196437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487585.372890:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294237824 00000100:00100000:3.0:1782487585.372893:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294237824 00000100:00100000:3.0:1782487585.372912:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212793168302 time 7212793068302 state 0x1 ref 3 00000100:00100000:3.0:1782487585.372932:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212793168302 time 7212794322293 state 0x0 ref 3 00000100:00100000:3.0:1782487585.372942:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+602:294251:x1869066294237824:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.372964:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487585.372978:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85a838 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773c7 expref: 602 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373016:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85a48e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47725b expref: 602 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373031:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85a4bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47729a expref: 601 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373041:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb16:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.373044:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.373057:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373066:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373074:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373087:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373095:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373103:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373532:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373547:0:190299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 985 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373555:0:190299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373579:0:190299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 985 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.373589:0:190299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 985 pid: 190298 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.373624:0:190299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190299:1869066299218304:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487585.373666:0:190299:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e5c300 going to sleep for 11 seconds 00000100:00100000:3.0:1782487585.377266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.377307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.377368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.377467:0:190299:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.21@tcp) returned -22 from blocking AST (req@000000005f4fe6a0 x1869066299218304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 987 pid: 190298 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377483:0:190299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 987 pid: 190298 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377503:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85acad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47753a expref: 987 pid: 190298 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.377530:0:190299:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190299:1869066299218304:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487585.377555:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb16:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.377560:0:190299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377567:0:190299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377572:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377586:0:190299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377595:0:190299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.377602:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.378141:0:190299:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000bd1:0xb16:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1782487585.378270:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378277:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378284:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378290:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.378295:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378301:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378311:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb16:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.378314:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.378318:0:190299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85acec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378325:0:190299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85acec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378331:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85acec lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378351:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378358:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85acde lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378372:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378378:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378384:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378391:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.378395:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378402:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378414:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.378417:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.378420:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378425:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85acbb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.378436:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f586cad2 reply state 0000000018d774c5 transno 8589956635 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.378444:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.378476:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+602:294251:x1869066294237824:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5536us (5700us total) trans 8589956635 rc 0/0 00000100:00100000:3.0:1782487585.378483:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26692 00010000:00010000:3.0:1782487585.378523:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85a81c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b9 expref: 601 pid: 213218 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.378536:0:196437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4545fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196437:1869066299218176:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487585.378551:0:196437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378557:0:196437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.378563:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.378670:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9bd5033 reply state 00000000b1a00d74 transno 8589956637 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.378678:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.378717:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+988:294292:x1869066294237312:12345-192.168.202.21@tcp:36:touch.500 Request processed in 7236us (7427us total) trans 8589956637 rc 0/0 00000100:00100000:3.0:1782487585.378724:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26690 00000100:00100000:3.0:1782487585.378729:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212799357069 time 7212799463633 state 0x2 ref 0 00000100:00100000:3.0:1782487585.381112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.382585:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382596:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382604:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382639:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.382645:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382654:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382678:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.382683:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.382688:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382700:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30000/0x66475b4e8b85acc2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382730:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382738:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382755:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382772:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.382778:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382791:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382823:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb17:0x0].0x0 (ffff9cb4553a4000) 00010000:00010000:3.0:1782487585.382830:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.382835:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.382847:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85ac8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.384446:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294239232 00000100:00100000:3.0:1782487585.384453:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294239232 00000100:00100000:3.0:1782487585.384483:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212802731694 time 7212804342626 state 0x0 ref 1 00000100:00100000:3.0:1782487585.384499:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212804442626 time 7212804342626 state 0x1 ref 1 00000100:00100000:3.0:1782487585.384536:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294239360 00000100:00100000:3.0:1782487585.384540:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294239360 00000100:00100000:3.0:1782487585.384557:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212804442626 time 7212804342626 state 0x1 ref 2 00000100:00100000:3.0:1782487585.384575:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294239488 00000100:00100000:3.0:1782487585.384579:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294239488 00000100:00100000:3.0:1782487585.384596:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212804442626 time 7212804342626 state 0x1 ref 3 00000100:00100000:3.0:1782487585.384668:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212806158256 time 7212806058256 state 0x1 ref 4 00000100:00100000:3.0:1782487585.384680:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45488dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294261:x1869066294239232:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.384719:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.384737:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85a854 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ce expref: 601 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384755:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85a608 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477303 expref: 600 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384764:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1a:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487585.384771:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.384785:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384796:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384804:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384818:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85ad39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384827:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85ad39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384832:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85ad39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384914:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384920:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.384926:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.385650:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2506, 64 off168576 00010000:00010000:3.0:1782487585.385725:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.385734:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.385740:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.385746:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.385751:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.385754:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389587:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782487585.389599:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85ad6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389665:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389774:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389788:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389797:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.389802:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389811:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389827:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1a:0x0].0x0 (ffff9cb49c365200) 00010000:00010000:3.0:1782487585.389831:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.389836:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389842:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85ad40 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389870:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389881:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389887:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389893:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.389896:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389904:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389914:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.389918:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.389921:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.389927:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad32 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.389941:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c97dc46 reply state 0000000050e0f938 transno 8589956638 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85ad39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.390297:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.390431:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45488dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294261:x1869066294239232:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5750us (6063us total) trans 8589956638 rc 0/0 00000100:00100000:3.0:1782487585.390447:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26697 00000100:00100000:3.0:1782487585.390456:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212806376341 time 7212806437232 state 0x2 ref 0 00000100:00100000:3.0:1782487585.390874:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294240256 00000100:00100000:3.0:1782487585.390880:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294240256 00000100:00100000:3.0:1782487585.390915:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16079 00000100:00100000:3.0:1782487585.391348:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2361:x1869066294240128:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:3.0:1782487585.391501:0:213221:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1851:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782487585.391506:0:213221:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1851:0x0] updating lvb mtime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.391509:0:213221:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x1851:0x0] updating lvb atime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.391512:0:213221:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1851:0x0] updating lvb ctime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.391514:0:213221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1851:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782487585.391542:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2361:x1869066294240128:12345-192.168.202.21@tcp:2:touch.500 Request processed in 620us (1445us total) trans 8589940639 rc 0/0 00000100:00100000:3.0:1782487585.391550:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16079 00000100:00100000:3.0:1782487585.393979:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294240768 00000100:00100000:3.0:1782487585.393986:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294240768 00000100:00100000:3.0:1782487585.394015:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212806376341 time 7212806437232 state 0x0 ref 1 00000100:00100000:3.0:1782487585.394027:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212806537232 time 7212806437232 state 0x1 ref 1 00000100:00100000:3.0:1782487585.394050:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212806537232 time 7212815440023 state 0x0 ref 1 00000100:00100000:3.0:1782487585.394062:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294270:x1869066294240768:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.394105:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1782487585.394126:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85a9ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477445 expref: 601 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394153:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85a911 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477406 expref: 600 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394172:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85a88c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773dc expref: 599 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394191:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85a75f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47735e expref: 598 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394203:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1f:0x0].0x0 (ffff9cb56f8aae00) 00010000:00010000:3.0:1782487585.394226:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.394250:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394263:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394274:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394291:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394299:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394308:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394491:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394501:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.394517:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.395105:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2507, 64 off168640 00010000:00010000:3.0:1782487585.395178:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395187:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395198:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395204:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395232:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395255:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395285:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.395305:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395318:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395326:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395336:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.395341:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395349:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395371:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1f:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.395376:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.395381:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395390:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ad8d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395409:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395416:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395423:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395429:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.395433:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395440:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395452:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.395455:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.395459:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395465:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85ad7f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.395477:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e06f4530 reply state 000000002c75f640 transno 8589956640 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.395486:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.395551:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294270:x1869066294240768:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1490us (1739us total) trans 8589956640 rc 0/0 00000100:00100000:3.0:1782487585.395561:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26701 00010000:00010000:3.0:1782487585.395735:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.395742:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395750:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.395755:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395762:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395773:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1f:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.395776:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.395780:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395791:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ad9b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.395811:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.395814:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.395817:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.397199:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.397225:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85adb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.397243:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deaa00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.397249:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85adb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.397259:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85adb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.397281:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xadf:0x0].0x0 (ffff9cb546b6f700) 00010000:00010000:3.0:1782487585.397287:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.397292:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85adb0 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.397299:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85adb0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xadf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.397409:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.397414:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.397419:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.397937:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294241536 00000100:00100000:3.0:1782487585.397943:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294241536 00000100:00100000:3.0:1782487585.398000:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5710 00000100:00100000:3.0:1782487585.398012:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+991:294294:x1869066294241536:12345-192.168.202.21@tcp:35:touch.500 00000004:00080000:3.0:1782487585.398301:0:190300:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0xb16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782487585.399492:0:190300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2508, 64 off168704 00010000:00010000:3.0:1782487585.399568:0:190300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399582:0:190300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399593:0:190300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399602:0:190300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399629:0:190300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399636:0:190300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85adb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399658:0:190300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487585.399726:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+992:294294:x1869066294241536:12345-192.168.202.21@tcp:35:touch.500 Request processed in 1716us (1832us total) trans 8589956643 rc 0/0 00000100:00100000:3.0:1782487585.399736:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5710 00010000:00010000:3.0:1782487585.399788:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399797:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399808:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399814:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.399819:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399827:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399883:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.399887:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.399892:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.399899:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196dc00/0x66475b4e8b85ad86 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.403006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.403040:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294241920 00000100:00100000:3.0:1782487585.403045:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294241920 00000100:00100000:3.0:1782487585.403095:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212823362525 time 7212823262525 state 0x1 ref 2 00000100:00100000:3.0:1782487585.403144:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212823362525 time 7212824532129 state 0x0 ref 2 00000100:00100000:3.0:1782487585.403170:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+598:294256:x1869066294241920:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.403201:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.403236:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85add3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477580 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403361:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403373:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403383:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403397:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403405:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.403413:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406021:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406038:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406050:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.406084:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb17:0x0]: returning size 0 00000004:00200000:3.0:1782487585.406088:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.406106:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406123:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406132:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406139:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406147:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406153:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.406158:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406165:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406177:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.406180:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.406185:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406191:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85adda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406205:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406226:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406233:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406240:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.406244:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406251:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406309:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.406312:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.406316:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.406323:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ade1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409571:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85add3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477580 expref: 600 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409598:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477580 expref: 599 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409742:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb17:0x0].0x0 (ffff9cb4553a4000) 00010000:00010000:3.0:1782487585.409746:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.409750:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683ca600, rc 0) 00010000:00010000:3.0:1782487585.409861:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409868:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409873:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409877:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.409881:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409887:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409897:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4b6109600) 00010000:00010000:3.0:1782487585.409899:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.409901:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.409906:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85adc5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.409962:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294256:x1869066294241920:12345-192.168.202.21@tcp:101:rm.500 Request processed in 6804us (6966us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.409970:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26704 00000100:00100000:3.0:1782487585.409977:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212823362525 time 7212824532129 state 0x2 ref 0 00000100:00100000:3.0:1782487585.419705:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294242432 00000100:00100000:3.0:1782487585.419715:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294242432 00000100:00100000:3.0:1782487585.419749:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212824632129 time 7212832412021 state 0x0 ref 1 00000100:00100000:3.0:1782487585.419766:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212832512021 time 7212832412021 state 0x1 ref 1 00000100:00100000:3.0:1782487585.419800:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212832512021 time 7212841189162 state 0x0 ref 1 00000100:00100000:3.0:1782487585.419814:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294256:x1869066294242432:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.419868:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.419894:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85adef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477580 expref: 599 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.419917:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85a54b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772af expref: 598 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.419931:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb17:0x0].0x0 (ffff9cb4553a4000) 00010000:00010000:3.0:1782487585.419937:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.419959:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ae27 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.419973:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ae27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.419983:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ae27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.419998:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420007:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420015:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420133:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85ae35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420145:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85ae20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47759c expref: 990 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420153:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6000/0x66475b4e8b85ae35 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420184:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85ae20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47759c expref: 990 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.420199:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85ae20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47759c expref: 990 pid: 190296 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.420228:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4545fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299218432:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487585.420315:0:190298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb574e5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487585.421746:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294242688 00000100:00100000:3.0:1782487585.421752:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294242688 00000100:00100000:3.0:1782487585.421781:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212841289162 time 7212841189162 state 0x1 ref 2 00000100:00100000:3.0:1782487585.421809:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212841289162 time 7212843197368 state 0x0 ref 2 00000100:00100000:3.0:1782487585.421830:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+991:294314:x1869066294242688:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.421845:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.421858:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ae43 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4775a3 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.421999:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422011:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422022:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422037:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422051:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422062:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422148:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85ae58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422160:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85ae58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422169:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85ae58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.422178:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb18:0x0]: returning size 0 00010000:00010000:3.0:1782487585.422338:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422364:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422374:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422384:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.422389:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422397:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422410:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.422417:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.422423:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422432:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422446:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422453:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422459:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422465:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.422469:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422475:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422485:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.422489:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.422492:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422499:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422544:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ae43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775a3 expref: 994 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422564:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85ae58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775a3 expref: 992 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.422572:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb18:0x0].0x0 (ffff9cb558966800) 00010000:00010000:3.0:1782487585.422632:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.422637:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad6800, rc 0) 00000100:00100000:3.0:1782487585.422672:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+992:294314:x1869066294242688:12345-192.168.202.21@tcp:101:touch.500 Request processed in 847us (1160us total) trans 8589956645 rc 0/0 00000100:00100000:3.0:1782487585.422681:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26707 00010000:00010000:3.0:1782487585.427434:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427447:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427457:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427464:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.427470:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427479:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427496:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.427500:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.427505:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.427512:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ae2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.427856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.427900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.427934:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294243712 00000100:00100000:3.0:1782487585.427939:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294243712 00000100:00100000:3.0:1782487585.427962:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212849190924 time 7212849090924 state 0x1 ref 3 00000100:00100000:3.0:1782487585.427987:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212849477470 time 7212849377470 state 0x1 ref 3 00000100:00100000:3.0:1782487585.428000:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+598:294263:x1869066294243456:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.428029:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.428046:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85a8d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773f8 expref: 598 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428067:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85a66a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477318 expref: 597 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428079:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1b:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.428088:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.428104:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428115:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428124:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428140:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428149:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428156:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428285:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428295:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428303:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.428724:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212849477470 time 7212850113121 state 0x0 ref 3 00000100:00100000:3.0:1782487585.428740:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+992:294310:x1869066294243712:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.428751:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.428762:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ae89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4775b1 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428870:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428881:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428901:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428916:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428923:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.428933:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429008:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85aeb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429018:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85aeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429027:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85aeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.429035:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb19:0x0]: returning size 0 00010000:00010000:3.0:1782487585.429126:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429134:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429147:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429162:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.429167:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429184:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429196:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.429200:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.429206:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429229:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85ae90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429254:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429278:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429295:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429308:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.429316:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429330:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429349:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.429356:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.429361:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429379:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7400/0x66475b4e8b85ae9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429431:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ae89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775b1 expref: 995 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429453:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85aeb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775b1 expref: 994 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429475:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb19:0x0].0x0 (ffff9cb544e52700) 00010000:00010000:3.0:1782487585.429481:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.429486:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683ca600, rc 0) 00000100:00100000:3.0:1782487585.429536:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+994:294310:x1869066294243712:12345-192.168.202.21@tcp:101:touch.500 Request processed in 799us (1681us total) trans 8589956647 rc 0/0 00000100:00100000:3.0:1782487585.429549:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26710 00000040:00080000:3.0:1782487585.429901:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2516, 64 off169216 00010000:00010000:3.0:1782487585.429980:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429990:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.429999:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430006:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430012:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430017:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85aec8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430037:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.430049:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430056:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430061:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430079:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.430084:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430097:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430119:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1b:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.430124:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.430127:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430138:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85ae82 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430159:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430168:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430174:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430180:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.430184:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430195:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430222:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.430225:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.430230:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.430236:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ae74 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.430249:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031b390c8 reply state 000000001d727b63 transno 8589956648 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.430257:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.430311:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294263:x1869066294243456:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2313us (2789us total) trans 8589956648 rc 0/0 00000100:00100000:3.0:1782487585.430320:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26709 00000100:00100000:3.0:1782487585.432042:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294243968 00000100:00100000:3.0:1782487585.432049:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294243968 00010000:00010000:3.0:1782487585.432079:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85a996 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773c0 expref: 599 pid: 190299 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432342:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432357:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432369:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432391:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.432399:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432414:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432428:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb49c365200) 00010000:00010000:3.0:1782487585.432432:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.432436:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432455:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85ae7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.432866:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294244352 00000100:00100000:3.0:1782487585.432871:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294244352 00000100:00100000:3.0:1782487585.432891:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212853725310 time 7212853625310 state 0x1 ref 2 00000100:00100000:3.0:1782487585.432913:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212853725310 time 7212854304151 state 0x0 ref 2 00000100:00100000:3.0:1782487585.432930:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+995:294317:x1869066294244352:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.432941:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.432951:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85aed6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4775bf expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.432990:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433002:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433016:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433035:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433043:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433052:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433114:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433122:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433129:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433135:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.433139:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433146:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433157:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.433160:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.433164:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433171:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85aedd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433183:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433190:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433196:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433202:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.433206:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433226:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433236:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.433239:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.433243:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433249:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85aee4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433280:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85aed6 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775bf expref: 996 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433296:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.433299:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.433304:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85aed6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775bf expref: 996 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.433315:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc 0) 00000100:00100000:3.0:1782487585.433350:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+995:294317:x1869066294244352:12345-192.168.202.21@tcp:101:rm.500 Request processed in 422us (521us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487585.433358:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26712 00000100:00100000:3.0:1782487585.433750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.434042:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434056:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434074:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434083:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.434089:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434101:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434126:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb18:0x0].0x0 (ffff9cb558966800) 00010000:00010000:3.0:1782487585.434134:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.434140:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.434160:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85ae6d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.434807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.435151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.435880:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435886:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435892:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435896:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.435900:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435907:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435917:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb19:0x0].0x0 (ffff9cb544e52700) 00010000:00010000:3.0:1782487585.435919:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.435921:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85af0e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435927:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85af0e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435931:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85af0e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435950:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.435959:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85aecf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.436596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.440731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.440765:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.440805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.443674:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5712 00000100:00100000:3.0:1782487585.443690:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1000:294314:x1869066294246144:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.443853:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1001:294314:x1869066294246144:12345-192.168.202.21@tcp:35:touch.500 Request processed in 168us (414us total) trans 8589956653 rc 0/0 00000100:00100000:3.0:1782487585.443862:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5712 00000100:00100000:3.0:1782487585.444369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.447729:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447739:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447747:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447753:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.447758:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447769:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447782:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae5:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:3.0:1782487585.447785:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.447789:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.447796:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85af62 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.448631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.449180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.452521:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294247296 00000100:00100000:3.0:1782487585.452527:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294247296 00000100:00100000:3.0:1782487585.452578:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16084 00000100:00100000:3.0:1782487585.452590:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294247296:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.452890:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294247296:12345-192.168.202.21@tcp:2:touch.500 Request processed in 302us (1615us total) trans 8589940641 rc 0/0 00000100:00100000:3.0:1782487585.452900:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16084 00010000:00010000:3.0:1782487585.456145:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.456152:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85afe0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.456160:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.456164:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85afe0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.456176:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85afe0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.456188:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1d:0x0].0x0 (ffff9cb45539c500) 00010000:00010000:3.0:1782487585.456191:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.456195:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85afe0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.456202:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85afe0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.456233:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.456236:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.456240:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.456575:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457261:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457269:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457275:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.457279:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457287:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457309:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb45539c100) 00010000:00010000:3.0:1782487585.457313:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.457317:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.457324:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6800/0x66475b4e8b85afd2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458693:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458702:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458709:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458715:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.458720:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458728:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458740:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb45539c400) 00010000:00010000:3.0:1782487585.458744:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.458748:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.458754:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85aff5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.459418:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294248832 00000100:00100000:3.0:1782487585.459424:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294248832 00000100:00100000:3.0:1782487585.459461:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212879496983 time 7212879396983 state 0x1 ref 2 00000100:00100000:3.0:1782487585.459549:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212879496983 time 7212880937235 state 0x0 ref 2 00000100:00100000:3.0:1782487585.459562:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1006:294325:x1869066294248832:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.459592:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.459649:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85affc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775fe expref: 1006 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.459664:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb45539cf00) 00010000:00010000:3.0:1782487585.459675:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.460287:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460310:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460320:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.460426:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054629a42 reply state 000000003dbba28a transno 8589956662 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.460435:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.460592:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1007:294325:x1869066294248832:12345-192.168.202.21@tcp:36:touch.500 Request processed in 1031us (1301us total) trans 8589956662 rc 0/0 00000100:00100000:3.0:1782487585.460601:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26727 00010000:00010000:3.0:1782487585.460647:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460659:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460667:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460673:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.460678:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460685:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460698:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb1c:0x0].0x0 (ffff9cb44297de00) 00010000:00010000:3.0:1782487585.460702:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.460705:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b01f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460712:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b01f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460718:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b01f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460741:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.460748:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b00a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.461527:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294248960 00000100:00100000:3.0:1782487585.461534:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294248960 00000100:00100000:3.0:1782487585.461560:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212881037235 time 7212880937235 state 0x1 ref 2 00000100:00100000:3.0:1782487585.461581:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294249216 00000100:00100000:3.0:1782487585.461584:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294249216 00000100:00100000:3.0:1782487585.461599:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212881037235 time 7212880937235 state 0x1 ref 3 00000100:00100000:3.0:1782487585.461662:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212883135084 time 7212883050817 state 0x0 ref 3 00000100:00100000:3.0:1782487585.461683:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1007:294334:x1869066294249216:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.461696:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.461709:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b034 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47760c expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461816:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461832:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461846:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461862:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461870:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.461878:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.462404:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x185b:0x0], index 0: 0 00010000:00010000:3.0:1782487585.462669:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85b049 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462679:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85b049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462688:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85b049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462721:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462728:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462735:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462742:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.462747:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462754:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462765:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.462769:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.462772:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462783:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85b03b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.462846:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a930adf reply state 00000000fa4d5e52 transno 8589956663 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.462855:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.462882:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b034 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47760c expref: 1010 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462898:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85b049 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47760c expref: 1009 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.462906:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb49c365b00) 00010000:00010000:3.0:1782487585.462909:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.462913:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc 0) 00000100:00100000:3.0:1782487585.462946:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1010:294334:x1869066294249216:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1269us (1560us total) trans 8589956663 rc 0/0 00000100:00100000:3.0:1782487585.462954:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26729 00010000:00010000:3.0:1782487585.464998:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465006:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465013:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465019:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.465024:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465032:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465043:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.465047:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.465050:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465056:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b026 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465700:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465710:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465718:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465724:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.465728:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465735:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465748:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb49c365200) 00010000:00010000:3.0:1782487585.465753:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.465759:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.465778:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85b042 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.465816:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294249472 00000100:00100000:3.0:1782487585.465822:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294249472 00000100:00100000:3.0:1782487585.465870:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16085 00000100:00100000:3.0:1782487585.465882:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+67:2361:x1869066294249472:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:3.0:1782487585.466065:0:195192:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x182d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782487585.466069:0:195192:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x182d:0x0] updating lvb mtime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.466073:0:195192:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x182d:0x0] updating lvb atime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.466076:0:195192:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x182d:0x0] updating lvb ctime from disk: 1782487585 -> 1782487585 00002000:00010000:3.0:1782487585.466079:0:195192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x182d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782487585.466108:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+68:2361:x1869066294249472:12345-192.168.202.21@tcp:2:touch.500 Request processed in 228us (863us total) trans 8589939978 rc 0/0 00000100:00100000:3.0:1782487585.466117:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16085 00010000:00010000:3.0:1782487585.466950:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.466958:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.466966:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.466972:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d5535e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.466976:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.466983:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.466994:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb45539ca00) 00010000:00010000:3.0:1782487585.466997:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.467001:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467007:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5535e00/0x66475b4e8b85b018 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.467486:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294250112 00000100:00100000:3.0:1782487585.467491:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294250112 00000100:00100000:3.0:1782487585.467510:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212886993902 time 7212886934487 state 0x0 ref 1 00000100:00100000:3.0:1782487585.467520:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212887034487 time 7212886934487 state 0x1 ref 1 00000100:00100000:3.0:1782487585.467540:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294250240 00000100:00100000:3.0:1782487585.467544:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294250240 00000100:00100000:3.0:1782487585.467559:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212887034487 time 7212886934487 state 0x1 ref 2 00000100:00100000:3.0:1782487585.467577:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294250368 00000100:00100000:3.0:1782487585.467637:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294250368 00000100:00100000:3.0:1782487585.467656:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212887034487 time 7212886934487 state 0x1 ref 3 00000100:00100000:3.0:1782487585.467679:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212889169154 time 7212889069154 state 0x1 ref 3 00000100:00100000:3.0:1782487585.467691:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+596:294311:x1869066294250112:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.467706:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.467718:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85b07a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477621 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467758:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467768:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467776:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467789:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467797:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467804:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467891:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467900:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467908:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.467928:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb25:0x0]: returning size 0 00000004:00200000:3.0:1782487585.467932:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.467946:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467957:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467965:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467970:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467977:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467983:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.467987:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.467993:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468003:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.468006:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.468009:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468016:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85b081 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468027:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468033:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468040:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468046:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.468049:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468056:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468066:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.468069:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.468072:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468078:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85b088 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468106:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85b07a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477621 expref: 598 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468118:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85b08f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477621 expref: 597 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468123:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb25:0x0].0x0 (ffff9cb546b6f500) 00010000:00010000:3.0:1782487585.468125:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.468127:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb455050600, rc 0) 00000100:00100000:3.0:1782487585.468159:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+597:294311:x1869066294250112:12345-192.168.202.21@tcp:101:rm.500 Request processed in 470us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.468170:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26733 00000100:00100000:3.0:1782487585.468193:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212889683278 time 7212889583278 state 0x1 ref 2 00000100:00100000:3.0:1782487585.468204:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+596:294279:x1869066294250240:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.468225:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.468235:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85b096 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477628 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468266:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468275:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468289:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468362:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468372:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468428:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468504:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468515:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468526:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.468589:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb20:0x0]: returning size 0 00000004:00200000:3.0:1782487585.468594:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.468626:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468639:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468650:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468657:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468665:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468701:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.468709:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468718:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468735:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.468742:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.468748:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468763:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85b09d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468780:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468792:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468810:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468827:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deaa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.468834:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468851:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468931:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb49c365e00) 00010000:00010000:3.0:1782487585.468940:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.468949:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.468969:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85b0a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469019:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85b096 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477628 expref: 604 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469060:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477628 expref: 602 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469069:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb20:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.469073:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.469076:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb400, rc 0) 00000100:00100000:3.0:1782487585.469107:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294279:x1869066294250240:12345-192.168.202.21@tcp:101:rm.500 Request processed in 902us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.469120:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26734 00000100:00100000:3.0:1782487585.469146:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212890635414 time 7212890535414 state 0x1 ref 4 00000100:00100000:3.0:1782487585.469166:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+600:294302:x1869066294250496:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.469174:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.469186:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85b0e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477636 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469228:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469238:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469247:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469261:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469272:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469280:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469397:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469406:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469414:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.469433:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb22:0x0]: returning size 0 00000004:00200000:3.0:1782487585.469578:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.469596:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469649:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469658:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469665:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469738:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469755:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.469759:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469766:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469777:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.469780:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.469784:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469790:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85b0ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469803:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469810:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469818:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469824:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.469828:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469835:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469848:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb49c365a00) 00010000:00010000:3.0:1782487585.469851:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.469855:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469872:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b0f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469910:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85b0e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477636 expref: 602 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469932:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477636 expref: 601 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.469942:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb22:0x0].0x0 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487585.469945:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.469948:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343400, rc 0) 00000100:00100000:3.0:1782487585.469976:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294302:x1869066294250496:12345-192.168.202.21@tcp:101:rm.500 Request processed in 814us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.469984:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26736 00000100:00100000:3.0:1782487585.470008:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294251392 00000100:00100000:3.0:1782487585.470013:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294251392 00000100:00100000:3.0:1782487585.470033:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212890635414 time 7212890535414 state 0x1 ref 4 00000100:00100000:3.0:1782487585.470059:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212891548285 time 7212891448285 state 0x1 ref 4 00000100:00100000:3.0:1782487585.470082:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+600:294305:x1869066294250624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.470102:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.470115:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b106 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47763d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470160:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470177:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470196:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470226:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470244:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470257:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470894:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470917:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470931:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.470961:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb23:0x0]: returning size 0 00000004:00200000:3.0:1782487585.470966:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.470980:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.470996:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471018:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471036:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471087:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471098:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.471105:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471116:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471139:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.471144:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.471149:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471157:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b10d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471179:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471201:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471226:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471239:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.471245:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471259:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471269:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb49c365d00) 00010000:00010000:3.0:1782487585.471272:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.471276:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471289:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b114 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471509:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b106 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47763d expref: 600 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471534:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b137 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47763d expref: 599 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471543:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb23:0x0].0x0 (ffff9cb558966b00) 00010000:00010000:3.0:1782487585.471546:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.471549:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d8400, rc 0) 00000100:00100000:3.0:1782487585.471584:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294305:x1869066294250624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1505us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.471593:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26737 00000100:00100000:3.0:1782487585.471634:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294251648 00000100:00100000:3.0:1782487585.471638:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294251648 00000100:00100000:3.0:1782487585.471661:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212892670024 time 7212892570024 state 0x1 ref 2 00000100:00100000:3.0:1782487585.471677:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212892670024 time 7212893067369 state 0x0 ref 2 00000100:00100000:3.0:1782487585.471689:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1015:294334:x1869066294251648:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.471699:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.471711:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b153 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477659 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471745:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477659 expref: 1016 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471762:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477659 expref: 1015 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.471782:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb45539c300) 00010000:00010000:3.0:1782487585.471785:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.471788:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d5534600, rc 0) 00000100:00100000:3.0:1782487585.471817:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1015:294334:x1869066294251648:12345-192.168.202.21@tcp:101:touch.500 Request processed in 130us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.472099:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26740 00010000:00010000:3.0:1782487585.472512:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472525:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472538:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472551:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.472556:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472563:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472575:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb45539c300) 00010000:00010000:3.0:1782487585.472578:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.472581:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.472588:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b073 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.473717:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294252416 00000100:00100000:3.0:1782487585.473722:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294252416 00000100:00100000:3.0:1782487585.473798:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16088 00000100:00100000:3.0:1782487585.473809:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2362:x1869066294252416:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.473819:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.473832:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47766e expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.473857:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1859:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.473870:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.473874:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.473882:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 117 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.473896:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 117 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.473907:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d5535e00, rc 0) 00000100:00100000:3.0:1782487585.473942:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2362:x1869066294252416:12345-192.168.202.21@tcp:101:rm.500 Request processed in 134us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.473950:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16088 00000100:00100000:3.0:1782487585.474591:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294252672 00000100:00100000:3.0:1782487585.474596:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294252672 00000100:00100000:3.0:1782487585.474659:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16089 00000100:00100000:3.0:1782487585.474668:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2362:x1869066294252672:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.475114:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2362:x1869066294252672:12345-192.168.202.21@tcp:2:touch.500 Request processed in 446us (755us total) trans 8589940642 rc 0/0 00000100:00100000:3.0:1782487585.475124:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16089 00000100:00100000:3.0:1782487585.476713:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294252160 00000100:00100000:3.0:1782487585.476719:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294252160 00010000:00010000:3.0:1782487585.476795:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477628 expref: 596 pid: 196437 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.476830:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6145 00000100:00100000:3.0:1782487585.476840:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+596:2361:x1869066294252160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.476851:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.476857:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477628 expref: 596 pid: 196437 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476871:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85b0ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477628 expref: 596 pid: 196437 timeout: 7312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476886:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb20:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.476891:0:190283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b199 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476899:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b199 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476906:0:190283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b199 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476921:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.476950:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+596:2361:x1869066294252160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 111us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.476958:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6145 00010000:00010000:3.0:1782487585.476989:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.476997:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.477005:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.477012:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.477017:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.477026:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.477103:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb54c47f700) 00010000:00010000:3.0:1782487585.477107:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.477112:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.477120:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587600/0x66475b4e8b85b14c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.480635:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294253312 00000100:00100000:3.0:1782487585.480643:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294253312 00000100:00100000:3.0:1782487585.480684:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5716 00000100:00100000:3.0:1782487585.480693:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1017:294334:x1869066294253312:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.481018:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1018:294334:x1869066294253312:12345-192.168.202.21@tcp:35:touch.500 Request processed in 327us (3750us total) trans 8589956670 rc 0/0 00000100:00100000:3.0:1782487585.481026:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5716 00010000:00010000:3.0:1782487585.481053:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481067:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481075:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481082:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.481087:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481095:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481108:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae9:0x0].0x0 (ffff9cb45539c600) 00010000:00010000:3.0:1782487585.481112:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.481117:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.481124:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b1a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.482997:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483008:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483016:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483023:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.483027:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483035:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483047:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb5588ee800) 00010000:00010000:3.0:1782487585.483050:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.483054:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85b1b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483063:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85b1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483071:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85b1b5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483101:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.483108:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b192 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.483901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.483969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.486566:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486577:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486584:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486591:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.486594:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486599:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486624:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4b6109300) 00010000:00010000:3.0:1782487585.486628:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.486631:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.486637:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85b1d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.487716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.487909:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212909398197 time 7212909298197 state 0x1 ref 2 00000100:00100000:3.0:1782487585.487923:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1019:294330:x1869066294254720:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.487947:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.487967:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b202 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477691 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488010:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488022:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488035:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488049:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488055:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488063:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488127:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488134:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488139:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488145:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.488149:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488155:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488165:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.488168:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.488171:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488178:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85b209 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488189:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488195:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488201:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488217:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.488222:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488229:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488238:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb49c365d00) 00010000:00010000:3.0:1782487585.488241:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.488244:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488250:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85b210 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488278:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b202 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477691 expref: 1021 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488301:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.488304:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.488309:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b202 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477691 expref: 1021 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488321:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343600, rc 0) 00000100:00100000:3.0:1782487585.488345:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1019:294330:x1869066294254720:12345-192.168.202.21@tcp:101:rm.500 Request processed in 426us (635us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487585.488352:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26746 00000100:00100000:3.0:1782487585.488357:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212909398197 time 7212909307888 state 0x2 ref 0 00000100:00100000:3.0:1782487585.488594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.488691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.488760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.488885:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910359153 time 7212910275141 state 0x0 ref 2 00000100:00100000:3.0:1782487585.488895:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1019:294336:x1869066294255360:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.488903:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.488913:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b21e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477698 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488944:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488955:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488968:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488980:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488988:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.488996:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489074:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489082:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489090:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.489110:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xae5:0x0]: returning size 0 00000004:00200000:3.0:1782487585.489114:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.489187:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489199:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489219:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489230:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489236:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489242:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.489246:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489253:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489262:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.489265:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.489268:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489274:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85b225 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489284:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489391:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489400:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489406:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.489411:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489417:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489424:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb49c365a00) 00010000:00010000:3.0:1782487585.489427:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.489429:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489435:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85b22c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489461:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85b21e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477698 expref: 1021 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489474:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85b241 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xae5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477698 expref: 1020 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489482:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae5:0x0].0x0 (ffff9cb45539cd00) 00010000:00010000:3.0:1782487585.489490:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.489493:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70800, rc 0) 00000100:00100000:3.0:1782487585.489524:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1020:294336:x1869066294255360:12345-192.168.202.21@tcp:101:rm.500 Request processed in 630us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.489532:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26749 00010000:00010000:3.0:1782487585.489934:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.489940:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b24f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489951:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.489955:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b24f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489962:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b24f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489972:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb25:0x0].0x0 (ffff9cb54c47f000) 00010000:00010000:3.0:1782487585.489975:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.489979:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b24f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.489985:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b24f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490006:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.490009:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.490012:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.490048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.490111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.490179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.490222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.490280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.490313:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490321:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490327:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490333:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.490337:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490344:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490355:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaea:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:3.0:1782487585.490357:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.490361:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.490367:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b217 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.491830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.492041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.492069:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294255488 00000100:00100000:3.0:1782487585.492073:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294255488 00000100:00100000:3.0:1782487585.492094:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910359153 time 7212910275141 state 0x0 ref 1 00000100:00100000:3.0:1782487585.492105:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910375141 time 7212910275141 state 0x1 ref 1 00000100:00100000:3.0:1782487585.492122:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294255616 00000100:00100000:3.0:1782487585.492125:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294255616 00000100:00100000:3.0:1782487585.492139:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910375141 time 7212910275141 state 0x1 ref 2 00000100:00100000:3.0:1782487585.492150:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294256000 00000100:00100000:3.0:1782487585.492154:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294256000 00000100:00100000:3.0:1782487585.492166:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910375141 time 7212910275141 state 0x1 ref 3 00000100:00100000:3.0:1782487585.492176:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294256384 00000100:00100000:3.0:1782487585.492179:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294256384 00000100:00100000:3.0:1782487585.492192:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212910375141 time 7212910275141 state 0x1 ref 4 00000100:00100000:3.0:1782487585.492218:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212913696261 time 7212913596261 state 0x1 ref 4 00000100:00100000:3.0:1782487585.492230:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1026:294342:x1869066294255488:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.492240:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.492250:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b2d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47769f expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492279:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492288:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492306:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492319:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492327:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492335:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492392:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492400:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492408:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.492422:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xae7:0x0]: returning size 0 00000004:00200000:3.0:1782487585.492425:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.492434:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492443:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492450:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492457:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492464:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492470:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.492474:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492481:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492491:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.492494:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.492497:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492503:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b2e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492513:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492520:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492526:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492532:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.492536:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492543:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492552:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb49c365e00) 00010000:00010000:3.0:1782487585.492555:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.492558:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492563:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b2e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.492990:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b2d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47769f expref: 1030 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493006:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85b2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47769f expref: 1029 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493013:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.493016:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.493019:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb541391600, rc 0) 00000100:00100000:3.0:1782487585.493042:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1029:294342:x1869066294255488:12345-192.168.202.21@tcp:101:rm.500 Request processed in 816us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.493050:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26750 00000100:00100000:3.0:1782487585.493070:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212914561098 time 7212914461098 state 0x1 ref 3 00000100:00100000:3.0:1782487585.493080:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1028:294327:x1869066294256000:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.493088:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.493099:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b321 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47771d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493123:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47771d expref: 1029 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493134:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b321 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47771d expref: 1029 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493147:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaea:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.493150:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.493153:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547117200, rc 0) 00000100:00100000:3.0:1782487585.493174:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1028:294327:x1869066294256000:12345-192.168.202.21@tcp:101:touch.500 Request processed in 95us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.493181:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26752 00000100:00100000:3.0:1782487585.493198:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212914561098 time 7212914588907 state 0x0 ref 2 00000100:00100000:3.0:1782487585.493337:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+594:294302:x1869066294256384:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.493364:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.493379:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b0f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477636 expref: 594 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493398:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85abbf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774f4 expref: 593 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493408:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb22:0x0].0x0 (ffff9cb4b4027b00) 00010000:00010000:3.0:1782487585.493417:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.493426:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493434:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493442:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493452:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493459:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493470:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493541:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493549:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.493557:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.494448:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2512, 64 off168960 00010000:00010000:3.0:1782487585.494513:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494522:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494530:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494539:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494545:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494551:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b367 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494634:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.494648:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494655:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494662:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494667:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.494671:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494678:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494687:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb22:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.494689:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.494692:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494699:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b336 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494712:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494718:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494724:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494734:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.494738:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494745:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494754:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.494756:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.494759:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.494766:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88a00/0x66475b4e8b85b328 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.494776:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b04b4994 reply state 00000000686b06e2 transno 8589956677 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.494783:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.494819:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+594:294302:x1869066294256384:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1611us (2778us total) trans 8589956677 rc 0/0 00000100:00100000:3.0:1782487585.494825:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26753 00000100:00100000:3.0:1782487585.494897:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294256768 00000100:00100000:3.0:1782487585.494902:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294256768 00000100:00100000:3.0:1782487585.494933:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16095 00000100:00100000:3.0:1782487585.494941:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2360:x1869066294256768:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.494950:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.494961:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477763 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.494984:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x185c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782487585.494995:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.495000:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.495007:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 96 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.495021:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 96 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.495033:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd89200, rc 0) 00000100:00100000:3.0:1782487585.495066:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2360:x1869066294256768:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 125us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.495073:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16095 00000100:00100000:3.0:1782487585.498976:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16097 00000100:00100000:3.0:1782487585.498994:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+71:2360:x1869066294257024:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.499007:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.499025:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47776a expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.499052:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1834:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.499124:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:3.0:1782487585.499130:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.499142:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 72 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499268:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 73 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499281:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd88a00, rc 0) 00000100:00100000:3.0:1782487585.499316:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+72:2360:x1869066294257024:12345-192.168.202.21@tcp:101:rm.500 Request processed in 326us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.499325:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16097 00010000:00010000:3.0:1782487585.499406:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499417:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499424:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499431:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.499437:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499445:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499458:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.499503:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.499509:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.499520:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b32f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.500275:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294257536 00000100:00100000:3.0:1782487585.500280:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294257536 00000100:00100000:3.0:1782487585.500303:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212914688907 time 7212915261680 state 0x0 ref 1 00000100:00100000:3.0:1782487585.500314:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212915361680 time 7212915261680 state 0x1 ref 1 00000100:00100000:3.0:1782487585.500341:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212915361680 time 7212921731228 state 0x0 ref 1 00000100:00100000:3.0:1782487585.500365:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1025:294332:x1869066294257536:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.500378:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.500391:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85b38a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477778 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500516:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b391 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500531:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b391 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500542:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b391 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500557:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b398 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500565:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.500574:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85b398 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.503791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.503819:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294258048 00000100:00100000:3.0:1782487585.503823:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294258048 00000100:00100000:3.0:1782487585.503867:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5718 00000100:00100000:3.0:1782487585.503878:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1028:294327:x1869066294258048:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.504063:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1028:294327:x1869066294258048:12345-192.168.202.21@tcp:35:touch.500 Request processed in 188us (283us total) trans 8589956680 rc 0/0 00000100:00100000:3.0:1782487585.504070:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5718 00000100:00100000:3.0:1782487585.504487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.504525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.504650:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212926138421 time 7212926038421 state 0x1 ref 2 00000100:00100000:3.0:1782487585.504742:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1030:294332:x1869066294258304:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.504765:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.504779:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b39f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477778 expref: 1030 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.504792:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaeb:0x0].0x0 (ffff9cb4c9e2f500) 00010000:00010000:3.0:1782487585.504803:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.504860:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b3de lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.504872:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b3de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.504881:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b3de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.504972:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad9f6437 reply state 0000000087e0e2c0 transno 8589956681 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b3de lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.504978:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.505124:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1031:294332:x1869066294258304:12345-192.168.202.21@tcp:36:touch.500 Request processed in 462us (637us total) trans 8589956681 rc 0/0 00000100:00100000:3.0:1782487585.505130:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26757 00010000:00010000:3.0:1782487585.505407:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505416:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505423:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505430:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.505434:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505441:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505449:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487585.505452:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.505454:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.505462:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b3b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.508438:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294258816 00000100:00100000:3.0:1782487585.508446:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294258816 00000100:00100000:3.0:1782487585.508478:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212926138421 time 7212926050441 state 0x0 ref 1 00000100:00100000:3.0:1782487585.508491:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212926150441 time 7212926050441 state 0x1 ref 1 00000100:00100000:3.0:1782487585.508517:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212926150441 time 7212929906978 state 0x0 ref 1 00000100:00100000:3.0:1782487585.508533:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+591:294295:x1869066294258816:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.508580:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.508603:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587a00/0x66475b4e8b85b0dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47762f expref: 591 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.508706:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ab3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774df expref: 590 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.508718:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb21:0x0].0x0 (ffff9cb4b6109000) 00010000:00010000:3.0:1782487585.508730:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.508749:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.508760:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.508770:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509650:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b401 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509660:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509670:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509826:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509835:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509842:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509848:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.509852:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509859:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509870:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb44297d300) 00010000:00010000:3.0:1782487585.509873:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.509876:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509883:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85b3d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.509998:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510008:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510016:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.510541:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2514, 64 off169088 00010000:00010000:3.0:1782487585.510792:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510807:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510816:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510826:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510833:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510839:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b40f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510859:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.510880:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510892:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510899:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510906:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.510911:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510921:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510937:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb21:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.510945:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.510951:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.510968:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b408 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511002:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511015:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511033:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511051:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.511057:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511066:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511078:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.511083:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.511089:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.511098:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b3f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.511115:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092baa9b6 reply state 00000000f63dd4a4 transno 8589956683 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85b401 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.511133:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.511194:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+591:294295:x1869066294258816:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2664us (2809us total) trans 8589956683 rc 0/0 00000100:00100000:3.0:1782487585.511205:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26759 00000100:00100000:3.0:1782487585.513001:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294259584 00000100:00100000:3.0:1782487585.513007:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294259584 00000100:00100000:3.0:1782487585.513052:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16099 00000100:00100000:3.0:1782487585.513073:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+72:2362:x1869066294259584:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.513401:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+73:2362:x1869066294259584:12345-192.168.202.21@tcp:2:touch.500 Request processed in 336us (448us total) trans 8589939981 rc 0/0 00000100:00100000:3.0:1782487585.513410:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16099 00000100:00100000:3.0:1782487585.514018:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294259712 00000100:00100000:3.0:1782487585.514024:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294259712 00000100:00100000:3.0:1782487585.514045:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212932640408 time 7212932560126 state 0x0 ref 1 00000100:00100000:3.0:1782487585.514061:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212932660126 time 7212932560126 state 0x1 ref 1 00000100:00100000:3.0:1782487585.514103:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212932660126 time 7212935492075 state 0x0 ref 1 00000100:00100000:3.0:1782487585.514122:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1034:294337:x1869066294259712:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.514134:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.514149:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b440 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477794 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.514186:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b440 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477794 expref: 1034 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.514199:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85b440 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477794 expref: 1034 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.514283:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaec:0x0].0x0 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.514287:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.514290:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d8400, rc 0) 00000100:00100000:3.0:1782487585.514328:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1034:294337:x1869066294259712:12345-192.168.202.21@tcp:101:touch.500 Request processed in 209us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.514336:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26763 00000100:00100000:3.0:1782487585.514341:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212932660126 time 7212935492075 state 0x2 ref 0 00000100:00100000:3.0:1782487585.515049:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.515087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.515124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.515302:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212936756072 time 7212936691209 state 0x0 ref 2 00000100:00100000:3.0:1782487585.515378:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1034:294343:x1869066294260480:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.515389:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.515401:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b447 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47779b expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515503:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515516:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515525:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515540:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85b45c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515548:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85b45c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.515557:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85b45c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.516262:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x185e:0x0], index 0: 0 00010000:00010000:3.0:1782487585.516462:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b463 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516473:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516489:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516523:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516531:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516539:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516545:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.516550:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516558:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516569:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.516572:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.516576:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516582:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b455 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.516595:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df75e37d reply state 00000000951a3a59 transno 8589956687 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85b45c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.516602:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.516648:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b447 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47779b expref: 1038 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516665:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47779b expref: 1037 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.516674:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaee:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.516677:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.516680:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb576a0c800, rc 0) 00000100:00100000:3.0:1782487585.516720:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1039:294343:x1869066294260480:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1405us (1595us total) trans 8589956687 rc 0/0 00000100:00100000:3.0:1782487585.516729:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26765 00000100:00100000:3.0:1782487585.516737:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212936756072 time 7212936691209 state 0x2 ref 0 00000100:00100000:3.0:1782487585.516890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.519196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.519313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.519341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.519367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.522130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.522205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.522571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.522593:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294262016 00000100:00100000:3.0:1782487585.522597:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294262016 00000100:00100000:3.0:1782487585.522828:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5720 00000100:00100000:3.0:1782487585.522843:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1041:294337:x1869066294262016:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.523131:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1042:294337:x1869066294262016:12345-192.168.202.21@tcp:35:touch.500 Request processed in 291us (558us total) trans 8589956690 rc 0/0 00000100:00100000:3.0:1782487585.523151:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5720 00000100:00100000:3.0:1782487585.523222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.524059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.526875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.527071:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.527505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.527552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.531254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.531836:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294262912 00000100:00100000:3.0:1782487585.531842:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294262912 00000100:00100000:3.0:1782487585.531895:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1147 00000100:00100000:3.0:1782487585.531905:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1043:2363:x1869066294262912:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.531917:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.531936:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b4b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaea:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777b7 expref: 1043 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.531953:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaea:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.531956:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.531999:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1042:2363:x1869066294262912:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 96us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.532005:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1147 00000100:00100000:3.0:1782487585.533364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.534280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.534308:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294263424 00000100:00100000:3.0:1782487585.534313:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294263424 00000100:00100000:3.0:1782487585.534356:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5722 00000100:00100000:3.0:1782487585.534365:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1040:294343:x1869066294263424:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.534653:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1041:294343:x1869066294263424:12345-192.168.202.21@tcp:35:touch.500 Request processed in 287us (374us total) trans 8589956692 rc 0/0 00000100:00100000:3.0:1782487585.534662:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5722 00010000:00010000:3.0:1782487585.536971:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.536977:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b520 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.536988:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92da00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.536996:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b520 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.537012:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b520 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.537033:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaea:0x0].0x0 (ffff9cb45017f800) 00010000:00010000:3.0:1782487585.537037:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.537042:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b520 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.537048:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b520 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.537064:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.537068:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.537074:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.551140:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551147:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551152:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551156:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.551158:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551162:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551170:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c9e2f200) 00010000:00010000:3.0:1782487585.551173:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.551175:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.551179:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b566 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.552718:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294264192 00000100:00100000:3.0:1782487585.552726:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294264192 00000100:00100000:3.0:1782487585.552750:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212965334875 time 7212970441438 state 0x0 ref 1 00000100:00100000:3.0:1782487585.552765:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212970541438 time 7212970441438 state 0x1 ref 1 00000100:00100000:3.0:1782487585.552788:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294264448 00000100:00100000:3.0:1782487585.552792:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294264448 00000100:00100000:3.0:1782487585.552808:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212970541438 time 7212970441438 state 0x1 ref 2 00000100:00100000:3.0:1782487585.552897:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212974387893 time 7212974287893 state 0x1 ref 2 00000100:00100000:3.0:1782487585.552944:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1045:294345:x1869066294264192:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.552981:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.552997:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b56d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777e8 expref: 1045 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.553023:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaef:0x0].0x0 (ffff9cb4c9e2f500) 00010000:00010000:3.0:1782487585.553038:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.553112:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b582 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.553123:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.553138:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.553267:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000351c9f31 reply state 00000000ab48fa7f transno 8589956695 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.553274:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.553357:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1044:294345:x1869066294264192:12345-192.168.202.21@tcp:36:touch.500 Request processed in 449us (683us total) trans 8589956695 rc 0/0 00000100:00100000:3.0:1782487585.553372:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26775 00010000:00010000:3.0:1782487585.554015:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.554024:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b597 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554042:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.554049:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b597 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554127:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b597 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554145:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae5:0x0].0x0 (ffff9cb45017f100) 00010000:00010000:3.0:1782487585.554218:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.554225:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b597 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554239:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b597 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554274:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.554279:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.554283:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.554982:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554992:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.554999:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.555006:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.555010:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.555017:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.555029:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb45017f300) 00010000:00010000:3.0:1782487585.555033:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.555038:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.555045:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b589 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.555233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.557267:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294265088 00000100:00100000:3.0:1782487585.557273:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294265088 00000100:00100000:3.0:1782487585.557294:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212976026250 time 7212976738734 state 0x0 ref 1 00000100:00100000:3.0:1782487585.557304:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212976838734 time 7212976738734 state 0x1 ref 1 00000100:00100000:3.0:1782487585.557331:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212976838734 time 7212978721414 state 0x0 ref 1 00000100:00100000:3.0:1782487585.557343:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1044:294352:x1869066294265088:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.557355:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.557367:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b5ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4777fd expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557459:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b5c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557472:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557482:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557498:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b5c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557507:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.557526:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481000/0x66475b4e8b85b5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.558677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.560221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.561051:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212981579140 time 7212982040453 state 0x2 ref 0 00000100:00100000:1.0:1782487585.562158:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294265856 00000100:00100000:1.0:1782487585.562164:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294265856 00000100:00100000:1.0:1782487585.562186:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212981579140 time 7212982040453 state 0x0 ref 1 00000100:00100000:1.0:1782487585.562197:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212982140453 time 7212982040453 state 0x1 ref 1 00000100:00100000:1.0:1782487585.562233:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212982140453 time 7212983623392 state 0x0 ref 1 00000100:00100000:1.0:1782487585.562246:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294352:x1869066294265856:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.562259:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.562276:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85b5f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47780b expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.562307:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85b5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47780b expref: 1048 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.562316:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85b5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47780b expref: 1048 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.562328:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf0:0x0].0x0 (ffff9cb45017fc00) 00010000:00010000:1.0:1782487585.562331:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.562333:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5735d7000, rc 0) 00000100:00100000:1.0:1782487585.562375:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1048:294352:x1869066294265856:12345-192.168.202.21@tcp:101:touch.500 Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.562384:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26782 00000100:00100000:1.0:1782487585.562389:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212982140453 time 7212983623392 state 0x2 ref 0 00000100:00100000:1.0:1782487585.563154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.563183:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294266112 00000100:00100000:3.0:1782487585.563189:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294266112 00000100:00100000:3.0:1782487585.563223:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212982140453 time 7212983623392 state 0x0 ref 1 00000100:00100000:3.0:1782487585.563233:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212983723392 time 7212983623392 state 0x1 ref 1 00000100:00100000:3.0:1782487585.563258:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212983723392 time 7212984648306 state 0x0 ref 1 00000100:00100000:3.0:1782487585.563271:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1048:294342:x1869066294266112:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.563316:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.563336:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85b2b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4776c2 expref: 1048 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563356:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85b057 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xae7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477613 expref: 1047 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563369:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb49c365600) 00010000:00010000:3.0:1782487585.563380:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.563397:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563408:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563417:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563432:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b607 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563441:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563449:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563564:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563574:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.563583:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.564251:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2515, 64 off169152 00010000:00010000:3.0:1782487585.564353:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564364:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564373:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564382:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564390:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564397:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564417:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.564433:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564436:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.564446:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564447:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564462:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564463:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35ec000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.564470:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564472:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.564479:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564484:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564488:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564497:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:1.0:1782487585.564500:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.564503:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564508:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae7:0x0].0x0 (ffff9cb49c365500) 00010000:00010000:3.0:1782487585.564513:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.564517:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564518:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35ec000/0x66475b4e8b85b615 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564540:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85b60e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xae7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.564547:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.564552:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.564555:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.564564:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564571:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564579:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564585:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.564589:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564597:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564628:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.564632:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.564636:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.564643:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85b600 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.564657:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006725afbe reply state 00000000a943b0a6 transno 8589956700 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92dc00/0x66475b4e8b85b607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.564666:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.564733:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1048:294342:x1869066294266112:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1463us (1579us total) trans 8589956700 rc 0/0 00000100:00100000:3.0:1782487585.564742:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26783 00000100:00100000:3.0:1782487585.564748:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212983723392 time 7212984648306 state 0x2 ref 0 00000100:00100000:3.0:1782487585.566512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.566594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.566635:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294266496 00000100:00100000:1.0:1782487585.566641:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294266496 00000100:00100000:3.0:1782487585.566662:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.566684:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988084960 time 7212987984960 state 0x1 ref 2 00000100:00100000:3.0:1782487585.566701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.566714:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294266624 00000100:00100000:1.0:1782487585.566729:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294266624 00000100:00100000:1.0:1782487585.566749:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988084960 time 7212987984960 state 0x1 ref 3 00000100:00100000:3.0:1782487585.566754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.566773:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294266752 00000100:00100000:1.0:1782487585.566777:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294266752 00000100:00100000:3.0:1782487585.566787:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294266880 00000100:00100000:3.0:1782487585.566793:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294266880 00000100:00100000:1.0:1782487585.566795:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988084960 time 7212987984960 state 0x1 ref 4 00000100:00100000:1.0:1782487585.566813:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988303745 time 7212988203745 state 0x1 ref 5 00000100:00100000:3.0:1782487585.566822:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988303745 time 7212988203745 state 0x1 ref 5 00000100:00100000:1.0:1782487585.566828:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294355:x1869066294266496:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.566839:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.566842:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7212988331826 time 7212988231826 state 0x1 ref 5 00010000:00010000:1.0:1782487585.566853:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b631 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477819 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.566854:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294357:x1869066294266624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.566867:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.566878:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85b63f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477820 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566893:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566911:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.566914:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.566930:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566930:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566952:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.566954:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566969:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.566995:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567000:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567022:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567039:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567073:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567092:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567103:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567112:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567130:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.567134:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaeb:0x0]: returning size 0 00000004:00200000:1.0:1782487585.567141:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487585.567151:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.567157:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.567173:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaed:0x0]: returning size 0 00010000:00010000:1.0:1782487585.567175:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.567179:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.567189:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567199:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567200:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567229:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567241:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567241:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567260:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567270:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567271:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.567279:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.567280:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567292:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567316:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.567322:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.567329:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567340:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b646 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567342:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567358:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567365:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567371:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.567373:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567377:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.567388:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567397:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.567401:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567409:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567424:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb45017fd00) 00010000:00010000:1.0:1782487585.567431:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.567436:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567443:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567447:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b654 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567456:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85b64d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567482:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567490:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567498:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b631 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477819 expref: 1055 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567500:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567516:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.567523:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567543:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477819 expref: 1054 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567546:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.567564:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaeb:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.567568:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.567572:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb44297df00) 00010000:00010000:1.0:1782487585.567572:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498400, rc 0) 00010000:00010000:3.0:1782487585.567577:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.567581:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567585:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85b65b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.567648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.567682:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85b63f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477820 expref: 1055 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567696:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477820 expref: 1054 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567705:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaed:0x0].0x0 (ffff9cb4c9e2f000) 00010000:00010000:3.0:1782487585.567708:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.567711:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343400, rc 0) 00000100:00100000:1.0:1782487585.567719:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294267136 00000100:00100000:1.0:1782487585.567722:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294267136 00000100:00100000:1.0:1782487585.567757:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5724 00000100:00100000:1.0:1782487585.567767:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:294352:x1869066294267136:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.567780:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:294357:x1869066294266624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 927us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.567786:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26786 00000100:00100000:3.0:1782487585.567807:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988903476 time 7212989197838 state 0x0 ref 3 00000100:00100000:3.0:1782487585.567815:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1054:294359:x1869066294266880:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.567822:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.567831:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b685 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47782e expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567855:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567861:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567868:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567881:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567886:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567891:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567970:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.567995:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.567995:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1056:294352:x1869066294267136:12345-192.168.202.21@tcp:35:touch.500 Request processed in 227us (346us total) trans 8589956701 rc 0/0 00010000:00010000:3.0:1782487585.568013:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.568014:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5724 00000004:00200000:3.0:1782487585.568039:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaef:0x0]: returning size 0 00000004:00200000:3.0:1782487585.568043:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.568054:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.568068:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:294355:x1869066294266496:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1243us (1473us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.568073:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.568088:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26785 00010000:00010000:3.0:1782487585.568092:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568105:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568112:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568120:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.568125:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568137:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568148:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.568150:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.568153:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568159:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85b68c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568180:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568188:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568204:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568232:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.568238:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568251:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568262:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb44297d300) 00010000:00010000:3.0:1782487585.568266:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.568270:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568278:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85b693 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568312:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85b685 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47782e expref: 1054 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568325:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47782e expref: 1053 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.568333:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaef:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:3.0:1782487585.568336:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.568339:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1a00, rc 0) 00000100:00100000:3.0:1782487585.568363:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1053:294359:x1869066294266880:12345-192.168.202.21@tcp:101:rm.500 Request processed in 548us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.568373:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26788 00000100:00100000:3.0:1782487585.568379:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988903476 time 7212989197838 state 0x2 ref 0 00000100:00100000:1.0:1782487585.569137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.569165:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294267264 00000100:00100000:1.0:1782487585.569169:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294267264 00000100:00100000:1.0:1782487585.569202:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16106 00000100:00100000:1.0:1782487585.569226:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294267264:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.569237:0:213220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.569251:0:213220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477835 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.569274:0:213220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x185d:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:1.0:1782487585.569288:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:1.0:1782487585.569292:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.569301:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 102 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.569316:0:213220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 102 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.569327:0:213220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35ec000, rc 0) 00000100:00100000:1.0:1782487585.569399:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066294267264:12345-192.168.202.21@tcp:101:rm.500 Request processed in 188us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.569407:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16106 00000100:00100000:3.0:1782487585.570177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.570320:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294267392 00000100:00100000:1.0:1782487585.570326:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294267392 00000100:00100000:3.0:1782487585.570351:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.570368:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294267520 00000100:00100000:1.0:1782487585.570372:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294267520 00000100:00100000:1.0:1782487585.570411:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16108 00000100:00100000:3.0:1782487585.570427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.570429:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066294267520:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.570443:0:213226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.570459:0:213226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477843 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.570476:0:213226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x185e:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:1.0:1782487585.570493:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:1.0:1782487585.570500:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.570513:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 103 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.570532:0:213226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 103 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.570542:0:213226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579765e00, rc 0) 00000100:00100000:1.0:1782487585.570572:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066294267520:12345-192.168.202.21@tcp:101:rm.500 Request processed in 150us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.570581:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16108 00000100:00100000:3.0:1782487585.572340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.572418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.572920:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294268160 00000100:00100000:1.0:1782487585.572927:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294268160 00000100:00100000:1.0:1782487585.572972:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16110 00000100:00100000:1.0:1782487585.572983:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294268160:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.572995:0:213227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.573012:0:213227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477851 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.573031:0:213227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1838:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:1.0:1782487585.573042:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=7212s v=(0 0) 00010000:00010000:1.0:1782487585.573046:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.573054:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 78 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573083:0:213227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 78 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573094:0:213227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196dc00, rc 0) 00000100:00100000:1.0:1782487585.573131:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2361:x1869066294268160:12345-192.168.202.21@tcp:101:rm.500 Request processed in 150us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.573138:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16110 00000100:00100000:1.0:1782487585.573166:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294268032 00000100:00100000:1.0:1782487585.573170:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294268032 00000100:00100000:1.0:1782487585.573201:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212988903476 time 7212989197838 state 0x0 ref 1 00000100:00100000:1.0:1782487585.573222:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212989297838 time 7212989197838 state 0x1 ref 1 00000100:00100000:1.0:1782487585.573246:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212989297838 time 7212994635737 state 0x0 ref 1 00000100:00100000:1.0:1782487585.573256:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294353:x1869066294268032:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.573295:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.573313:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85b29c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xae9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4776ad expref: 1052 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573334:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586600/0x66475b4e8b85b1bc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xae9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47768a expref: 1051 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573347:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae9:0x0].0x0 (ffff9cb54c47f200) 00010000:00010000:1.0:1782487585.573356:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.573375:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573388:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573398:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573412:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85b6d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573420:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85b6d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573427:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85b6d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573556:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573565:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.573575:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.574115:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2516, 64 off169216 00010000:00010000:1.0:1782487585.574198:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574220:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574233:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574241:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574249:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574256:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574278:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.574295:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574302:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574309:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574313:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.574316:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.574321:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574322:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574342:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574346:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.574355:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae9:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.574360:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.574364:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574367:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574373:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85b6d9 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xae9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574381:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574393:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574396:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae9:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487585.574402:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.574405:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574407:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574424:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85b6e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574424:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574439:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.574444:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574450:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.574452:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.574453:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.574459:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.574467:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.574471:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.574475:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.574480:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85b6cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.574494:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004419ffec reply state 00000000d4f7e44e transno 8589956702 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85b6d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.574507:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.574558:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294353:x1869066294268032:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1302us (2220us total) trans 8589956702 rc 0/0 00000100:00100000:1.0:1782487585.574567:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26789 00000100:00100000:1.0:1782487585.574573:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212989297838 time 7212994635737 state 0x2 ref 0 00000100:00100000:3.0:1782487585.575905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.575936:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294268416 00000100:00100000:1.0:1782487585.575941:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294268416 00000100:00100000:1.0:1782487585.575960:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212989297838 time 7212994635737 state 0x0 ref 1 00000100:00100000:1.0:1782487585.575968:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212994735737 time 7212994635737 state 0x1 ref 1 00000100:00100000:1.0:1782487585.575988:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212994735737 time 7212997379087 state 0x0 ref 1 00000100:00100000:1.0:1782487585.575997:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1051:294344:x1869066294268416:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.576035:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.576050:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85b494 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777b0 expref: 1051 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576066:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b153 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xae8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477659 expref: 1050 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576088:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb45539c300) 00010000:00010000:1.0:1782487585.576098:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.576114:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576126:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576133:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576143:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576148:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576153:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576256:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576262:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576267:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.576679:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2523, 64 off169664 00000004:00080000:1.0:1782487585.576689:0:190298:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7212998081186ns, next at 7213998078374ns, rc = 0 00010000:00010000:1.0:1782487585.576774:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576781:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576790:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576796:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576800:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576805:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576822:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.576838:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.576842:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576849:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.576853:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576859:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576869:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb4664e1b00) 00010000:00010000:1.0:1782487585.576871:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.576875:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576881:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b6fc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xae8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576897:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.576900:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.576903:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.576916:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576923:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576930:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576936:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.576940:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576946:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.576956:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xae8:0x0].0x0 (ffff9cb4664e1b00) 00010000:00010000:1.0:1782487585.576959:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.576963:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577015:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b6f5 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xae8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577056:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577062:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577066:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577082:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.577086:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577093:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577120:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.577124:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.577127:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.577134:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b6e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.577159:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cb91f62 reply state 000000000e23f155 transno 8589956703 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.577185:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.577294:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1051:294344:x1869066294268416:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1296us (1392us total) trans 8589956703 rc 0/0 00000100:00100000:1.0:1782487585.577302:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26790 00000100:00100000:1.0:1782487585.577308:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212994735737 time 7212997379087 state 0x2 ref 0 00010000:00010000:1.0:1782487585.580801:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580814:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580820:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580825:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.580828:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580834:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580847:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4664e1500) 00010000:00010000:1.0:1782487585.580849:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.580852:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.580857:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b6ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.584015:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294268928 00000100:00100000:1.0:1782487585.584023:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294268928 00000100:00100000:1.0:1782487585.584049:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7212997479087 time 7213002693039 state 0x0 ref 1 00000100:00100000:1.0:1782487585.584061:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213002793039 time 7213002693039 state 0x1 ref 1 00000100:00100000:1.0:1782487585.584092:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213002793039 time 7213005481638 state 0x0 ref 1 00000100:00100000:1.0:1782487585.584106:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1049:294358:x1869066294268928:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.584144:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.584164:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85b53c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777e1 expref: 1049 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584258:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85b4fd lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777cc expref: 1048 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584273:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaee:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487585.584287:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.584312:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584323:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584332:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584348:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584355:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584364:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584473:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584483:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.584492:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.585062:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2525, 64 off169792 00010000:00010000:1.0:1782487585.585149:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585160:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585169:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585178:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585198:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585205:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585235:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.585251:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585257:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.585258:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585268:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585269:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585284:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.585292:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585293:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.585300:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585304:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585312:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585329:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaee:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:3.0:1782487585.585334:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.585338:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585338:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaee:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.585346:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.585349:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85b734 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585352:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585363:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b72d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.585367:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.585372:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.585376:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.585387:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585395:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585402:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585407:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.585411:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585418:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585432:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.585435:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.585439:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.585445:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b71f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.585458:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a131a37a reply state 0000000021a5c3ac transno 8589956705 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.585467:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.585539:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1049:294358:x1869066294268928:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1435us (1574us total) trans 8589956705 rc 0/0 00000100:00100000:1.0:1782487585.585549:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26792 00000100:00100000:1.0:1782487585.585554:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213002793039 time 7213005481638 state 0x2 ref 0 00000100:00100000:3.0:1782487585.587429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.587488:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587500:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587509:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587516:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.587520:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587532:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587547:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4664e1b00) 00010000:00010000:1.0:1782487585.587551:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.587555:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587561:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b726 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.587604:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294269184 00000100:00100000:1.0:1782487585.587631:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294269184 00000100:00100000:1.0:1782487585.587659:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213002793039 time 7213005481638 state 0x0 ref 1 00000100:00100000:1.0:1782487585.587671:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213005581638 time 7213005481638 state 0x1 ref 1 00000100:00100000:1.0:1782487585.587697:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213005581638 time 7213009087212 state 0x0 ref 1 00000100:00100000:1.0:1782487585.587712:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1048:294355:x1869066294269184:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.587759:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.587775:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b662 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477819 expref: 1048 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587791:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b3fa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477786 expref: 1047 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587800:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaeb:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.587807:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.587821:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587829:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587836:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587847:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b742 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587851:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587856:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587962:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587970:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.587978:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.588448:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2517, 64 off169280 00010000:00010000:1.0:1782487585.588547:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588554:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588561:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588567:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588572:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588576:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588595:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.588624:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588628:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588632:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588635:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.588638:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588642:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588649:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaeb:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487585.588651:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.588654:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588658:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b749 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588673:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588679:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588685:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588691:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.588694:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588702:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588712:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.588715:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.588718:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.588724:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85b73b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.588733:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007191e808 reply state 00000000a0b9cbc5 transno 8589956706 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.588742:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.588806:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1048:294355:x1869066294269184:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1097us (1382us total) trans 8589956706 rc 0/0 00000100:00100000:1.0:1782487585.588814:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26793 00000100:00100000:1.0:1782487585.588819:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213005581638 time 7213009087212 state 0x2 ref 0 00010000:00010000:3.0:1782487585.589383:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.589390:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.589398:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.589402:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.589416:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.589428:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaeb:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.589432:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.589436:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.589442:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b750 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaeb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.589460:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.589463:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.589466:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487585.591067:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294269440 00000100:00100000:1.0:1782487585.591076:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294269440 00000100:00100000:1.0:1782487585.591115:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213005581638 time 7213009087212 state 0x0 ref 1 00000100:00100000:1.0:1782487585.591128:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213009187212 time 7213009087212 state 0x1 ref 1 00000100:00100000:1.0:1782487585.591158:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213009187212 time 7213012548288 state 0x0 ref 1 00000100:00100000:1.0:1782487585.591172:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294357:x1869066294269440:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.591241:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.591260:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85b669 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477820 expref: 1047 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591281:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85b471 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777a2 expref: 1046 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591303:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaed:0x0].0x0 (ffff9cb4c9e2f000) 00010000:00010000:1.0:1782487585.591314:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.591335:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591353:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591363:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591381:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591390:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591398:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591509:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591516:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.591522:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.592105:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2518, 64 off169344 00010000:00010000:1.0:1782487585.592187:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592198:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592218:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592228:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592235:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592242:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592258:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.592273:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.592277:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592282:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551446000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.592285:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592290:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592298:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaed:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.592300:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.592302:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592308:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b76c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592322:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.592324:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.592328:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.592343:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592351:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592358:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592363:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.592366:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592371:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592380:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaed:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.592382:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.592384:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592388:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b765 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592405:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592409:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592413:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592420:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.592424:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592428:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592435:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.592437:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.592439:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.592443:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b757 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.592451:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c813a7c reply state 000000001ffe2e18 transno 8589956707 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.592457:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.592522:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294357:x1869066294269440:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1353us (1503us total) trans 8589956707 rc 0/0 00000100:00100000:1.0:1782487585.592531:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26794 00000100:00100000:1.0:1782487585.592537:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213009187212 time 7213012548288 state 0x2 ref 0 00010000:00010000:1.0:1782487585.593248:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593257:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593269:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593275:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.593279:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593285:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593297:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487585.593300:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.593304:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593310:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85b75e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.593590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.593666:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294269696 00000100:00100000:1.0:1782487585.593672:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294269696 00000100:00100000:1.0:1782487585.593694:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213009187212 time 7213012548288 state 0x0 ref 1 00000100:00100000:1.0:1782487585.593705:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213012648288 time 7213012548288 state 0x1 ref 1 00000100:00100000:1.0:1782487585.593732:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213012648288 time 7213015121529 state 0x0 ref 1 00000100:00100000:1.0:1782487585.593746:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4b4fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1046:294359:x1869066294269696:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.593781:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.593799:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85b6a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47782e expref: 1046 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593819:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85b59e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777ef expref: 1045 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593829:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaef:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487585.593838:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.593850:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593858:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593864:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593875:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593880:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593886:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593956:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593961:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.593966:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.594426:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2519, 64 off169408 00010000:00010000:1.0:1782487585.594511:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594521:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594529:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594537:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594543:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594549:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b788 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594564:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.594579:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594585:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594592:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594597:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.594602:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594637:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594663:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaef:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.594668:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.594672:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594688:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b781 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaef:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594712:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594723:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594735:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594752:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.594756:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594764:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594776:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.594782:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.594786:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.594796:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85b773 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.594807:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcb06a2f reply state 000000006dc015e3 transno 8589956708 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.594815:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.594876:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4b4fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1046:294359:x1869066294269696:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1133us (1288us total) trans 8589956708 rc 0/0 00000100:00100000:1.0:1782487585.594886:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26795 00000100:00100000:1.0:1782487585.594892:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213012648288 time 7213015121529 state 0x2 ref 0 00000100:00100000:3.0:1782487585.595807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.595890:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294269824 00000100:00100000:1.0:1782487585.595895:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294269824 00000100:00100000:1.0:1782487585.595916:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213012648288 time 7213015121529 state 0x0 ref 1 00000100:00100000:1.0:1782487585.595924:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213015221529 time 7213015121529 state 0x1 ref 1 00000100:00100000:1.0:1782487585.595945:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213015221529 time 7213017335283 state 0x0 ref 1 00000100:00100000:1.0:1782487585.595959:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1046:294360:x1869066294269824:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.595974:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.595986:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b78f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477858 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596035:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596046:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596057:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596073:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596081:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596089:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596203:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596226:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596235:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.596262:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf0:0x0]: returning size 0 00000004:00200000:1.0:1782487585.596266:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.596282:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596292:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596300:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596311:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596318:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596324:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.596328:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596335:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596347:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.596350:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.596354:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596360:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b796 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596374:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596381:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596388:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596394:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.596398:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596405:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596416:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.596419:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.596423:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596429:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85b79d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596467:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b78f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477858 expref: 1048 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596485:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477858 expref: 1047 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.596493:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf0:0x0].0x0 (ffff9cb45017fc00) 00010000:00010000:1.0:1782487585.596495:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.596498:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551446000, rc 0) 00000100:00100000:1.0:1782487585.596556:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294360:x1869066294269824:12345-192.168.202.21@tcp:101:rm.500 Request processed in 601us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.596563:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26796 00000100:00100000:1.0:1782487585.596568:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213015221529 time 7213017335283 state 0x2 ref 0 00010000:00010000:3.0:1782487585.597744:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597757:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597765:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597772:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.597777:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597785:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597800:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4664e1b00) 00010000:00010000:3.0:1782487585.597804:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.597808:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.597815:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85b77a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.597966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.598019:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294269952 00000100:00100000:3.0:1782487585.598026:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294269952 00000100:00100000:3.0:1782487585.598075:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16111 00000100:00100000:3.0:1782487585.598086:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2362:x1869066294269952:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.598099:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.598118:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47785f expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.598143:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x185f:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.598159:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.598164:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.598174:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 104 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.598192:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 104 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.598204:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54a00, rc 0) 00000100:00100000:3.0:1782487585.598336:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2362:x1869066294269952:12345-192.168.202.21@tcp:101:rm.500 Request processed in 250us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.598345:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16111 00000100:00100000:3.0:1782487585.599742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.599763:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294270208 00000100:00100000:1.0:1782487585.599770:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294270208 00000100:00100000:1.0:1782487585.599863:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213015221529 time 7213017335283 state 0x0 ref 1 00000100:00100000:1.0:1782487585.599873:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213017435283 time 7213017335283 state 0x1 ref 1 00000100:00100000:1.0:1782487585.599899:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213017435283 time 7213021289197 state 0x0 ref 1 00000100:00100000:1.0:1782487585.599913:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1046:294360:x1869066294270208:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.599957:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.599978:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b7a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477858 expref: 1046 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600005:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85b5f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47780b expref: 1045 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600020:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf0:0x0].0x0 (ffff9cb45017fc00) 00010000:00010000:1.0:1782487585.600033:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.600051:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600060:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600074:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600085:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b7b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600091:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600097:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600230:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600248:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.600257:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.600932:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2526, 64 off169856 00010000:00010000:1.0:1782487585.601030:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601038:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601043:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601050:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601055:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601058:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601074:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.601088:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601093:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601098:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601099:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.601108:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601108:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.601115:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601121:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.601126:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601127:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601147:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf0:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.601148:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601154:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.601159:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601164:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85b7c0 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601167:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf0:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.601171:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.601175:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601178:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601188:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b7c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601189:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601204:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601226:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.601230:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.601230:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.601235:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.601240:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.601240:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601253:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.601257:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.601261:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.601266:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.601277:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c67d5fb reply state 00000000fa5777a1 transno 8589956709 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.601283:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.601349:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1046:294360:x1869066294270208:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1438us (1608us total) trans 8589956709 rc 0/0 00000100:00100000:1.0:1782487585.601358:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26797 00000100:00100000:1.0:1782487585.601364:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213017435283 time 7213021289197 state 0x2 ref 0 00000100:00100000:3.0:1782487585.626575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.629353:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629363:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629370:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629377:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.629381:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629389:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629402:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb49c365100) 00010000:00010000:3.0:1782487585.629405:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.629409:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.629415:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b7dc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.630934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.631020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.631059:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294270720 00000100:00100000:1.0:1782487585.631067:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294270720 00000100:00100000:1.0:1782487585.631104:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213021389197 time 7213048233829 state 0x0 ref 1 00000100:00100000:1.0:1782487585.631129:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213048333829 time 7213048233829 state 0x1 ref 2 00000100:00100000:1.0:1782487585.631158:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213052647402 time 7213052547402 state 0x1 ref 2 00000100:00100000:1.0:1782487585.631176:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+593:294370:x1869066294270720:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.631245:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.631266:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b7e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477866 expref: 594 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.631282:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb49c365d00) 00010000:00010000:1.0:1782487585.631604:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.631694:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85b806 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.631705:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85b806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.631715:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85b806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.631842:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000338db59f reply state 00000000265c8d1e transno 8589956711 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85b806 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.631849:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.631926:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+595:294370:x1869066294270720:12345-192.168.202.21@tcp:36:touch.500 Request processed in 757us (996us total) trans 8589956711 rc 0/0 00000100:00100000:1.0:1782487585.631935:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26799 00010000:00010000:3.0:1782487585.637102:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637108:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637112:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637116:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.637119:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637127:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637135:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.637137:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.637140:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.637144:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85b7ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.639460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.639506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.639635:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294271360 00000100:00100000:1.0:1782487585.639640:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294271360 00000100:00100000:1.0:1782487585.639660:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213052657896 time 7213052557896 state 0x1 ref 2 00000100:00100000:1.0:1782487585.639684:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213061174175 time 7213061074175 state 0x1 ref 2 00000100:00100000:1.0:1782487585.639695:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+595:294371:x1869066294271488:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.639761:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.639786:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b80d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47786d expref: 595 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.639802:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb27:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487585.639813:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.639876:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b822 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.639889:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.639899:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.640028:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eee1af7a reply state 0000000097c9bde4 transno 8589956713 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85b822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.640037:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.640118:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+597:294371:x1869066294271488:12345-192.168.202.21@tcp:36:touch.500 Request processed in 424us (663us total) trans 8589956713 rc 0/0 00000100:00100000:1.0:1782487585.640127:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26801 00000100:00100000:1.0:1782487585.641366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.642827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.642861:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294271872 00000100:00100000:1.0:1782487585.642866:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294271872 00000100:00100000:1.0:1782487585.642888:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213061269172 time 7213062864500 state 0x0 ref 1 00000100:00100000:1.0:1782487585.642899:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213062964500 time 7213062864500 state 0x1 ref 1 00000100:00100000:1.0:1782487585.642923:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213062964500 time 7213064312993 state 0x0 ref 1 00000100:00100000:1.0:1782487585.642935:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+598:294372:x1869066294271872:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.642974:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.643055:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85b837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477874 expref: 598 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.643069:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.643080:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.643133:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b84c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.643141:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b84c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.643148:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b84c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.643259:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003523b6f8 reply state 0000000081e03771 transno 8589956715 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85b84c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.643268:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.643339:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+599:294372:x1869066294271872:12345-192.168.202.21@tcp:36:touch.500 Request processed in 405us (514us total) trans 8589956715 rc 0/0 00000100:00100000:1.0:1782487585.643348:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26804 00000100:00100000:1.0:1782487585.643354:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213062964500 time 7213064312993 state 0x2 ref 0 00010000:00010000:3.0:1782487585.643628:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643637:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643646:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643652:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.643656:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643664:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643677:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c9e2f000) 00010000:00010000:3.0:1782487585.643681:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.643685:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.643692:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b830 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.643805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.645030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.645068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.645159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.645187:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294272384 00000100:00100000:1.0:1782487585.645190:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294272384 00000100:00100000:1.0:1782487585.645236:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16112 00000100:00100000:1.0:1782487585.645246:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+92:2360:x1869066294272384:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.645485:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2360:x1869066294272384:12345-192.168.202.21@tcp:2:touch.500 Request processed in 241us (417us total) trans 8589939984 rc 0/0 00000100:00100000:1.0:1782487585.645494:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16112 00000100:00100000:1.0:1782487585.650036:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294272896 00000100:00100000:1.0:1782487585.650046:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294272896 00000100:00100000:1.0:1782487585.650079:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213066874777 time 7213066929869 state 0x0 ref 1 00000100:00100000:1.0:1782487585.650093:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213067029869 time 7213066929869 state 0x1 ref 1 00000100:00100000:1.0:1782487585.650127:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213067029869 time 7213071516370 state 0x0 ref 1 00000100:00100000:1.0:1782487585.650140:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+601:294368:x1869066294272896:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.650188:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.650204:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b868 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477882 expref: 601 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.650237:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb29:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487585.650247:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.650309:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b884 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.650322:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.650332:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.650445:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095e3cc0c reply state 0000000083fbeba6 transno 8589956717 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d5534600/0x66475b4e8b85b884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.650452:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.650536:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+602:294368:x1869066294272896:12345-192.168.202.21@tcp:36:touch.500 Request processed in 387us (602us total) trans 8589956717 rc 0/0 00000100:00100000:1.0:1782487585.650545:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26808 00000100:00100000:1.0:1782487585.650550:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213067029869 time 7213071516370 state 0x2 ref 0 00000100:00100000:1.0:1782487585.650811:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.650926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.651068:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294272640 00000100:00100000:3.0:1782487585.651073:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294272640 00000100:00100000:3.0:1782487585.651142:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16113 00000100:00100000:3.0:1782487585.651151:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2361:x1869066294272640:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.651408:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2361:x1869066294272640:12345-192.168.202.21@tcp:2:touch.500 Request processed in 256us (481us total) trans 8589940647 rc 0/0 00000100:00100000:3.0:1782487585.651416:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16113 00000100:00100000:1.0:1782487585.653642:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294273536 00000100:00100000:1.0:1782487585.653649:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294273536 00000100:00100000:1.0:1782487585.653700:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5725 00000100:00100000:1.0:1782487585.653711:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+605:294370:x1869066294273536:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.653990:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+606:294370:x1869066294273536:12345-192.168.202.21@tcp:35:touch.500 Request processed in 271us (402us total) trans 8589956719 rc 0/0 00000100:00100000:1.0:1782487585.654002:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5725 00000100:00100000:3.0:1782487585.654815:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294273280 00000100:00100000:3.0:1782487585.654860:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294273280 00000100:00100000:3.0:1782487585.654898:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16114 00000100:00100000:3.0:1782487585.654908:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2363:x1869066294273280:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.655127:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+94:2363:x1869066294273280:12345-192.168.202.21@tcp:2:touch.500 Request processed in 221us (701us total) trans 8589939985 rc 0/0 00000100:00100000:3.0:1782487585.655136:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16114 00000100:00100000:1.0:1782487585.655331:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294273792 00000100:00100000:1.0:1782487585.655336:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294273792 00000100:00100000:1.0:1782487585.655371:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5726 00000100:00100000:1.0:1782487585.655384:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+604:294371:x1869066294273792:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.655558:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+605:294371:x1869066294273792:12345-192.168.202.21@tcp:35:touch.500 Request processed in 178us (1082us total) trans 8589956720 rc 0/0 00000100:00100000:1.0:1782487585.655566:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5726 00000100:00100000:1.0:1782487585.655796:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294273920 00000100:00100000:1.0:1782487585.655801:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294273920 00000100:00100000:1.0:1782487585.655823:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213071616370 time 7213072346771 state 0x0 ref 1 00000100:00100000:1.0:1782487585.655834:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213072446771 time 7213072346771 state 0x1 ref 1 00000100:00100000:1.0:1782487585.656057:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213072446771 time 7213077446245 state 0x0 ref 1 00000100:00100000:1.0:1782487585.656071:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+605:294368:x1869066294273920:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.656082:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.656100:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b8ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47789e expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.656140:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b8ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47789e expref: 606 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.656158:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85b8ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47789e expref: 606 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.656180:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb29:0x0].0x0 (ffff9cb4664e1b00) 00010000:00010000:1.0:1782487585.656183:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.656248:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481a00, rc 0) 00000100:00100000:1.0:1782487585.656276:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+606:294368:x1869066294273920:12345-192.168.202.21@tcp:101:touch.500 Request processed in 207us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.656284:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26810 00000100:00100000:1.0:1782487585.656289:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213072446771 time 7213077446245 state 0x2 ref 0 00000100:00100000:3.0:1782487585.660647:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294274176 00000100:00100000:3.0:1782487585.660656:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294274176 00000100:00100000:3.0:1782487585.660692:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213072446771 time 7213077446245 state 0x0 ref 1 00000100:00100000:3.0:1782487585.660706:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213077546245 time 7213077446245 state 0x1 ref 1 00000100:00100000:3.0:1782487585.660739:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213077546245 time 7213082128859 state 0x0 ref 1 00000100:00100000:3.0:1782487585.660753:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+606:294373:x1869066294274176:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.660813:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.660841:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477897 expref: 606 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.660861:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.660873:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.660940:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.660951:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.660958:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.661074:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d84f839d reply state 000000007fb97cb5 transno 8589956721 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.661080:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.661169:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+607:294373:x1869066294274176:12345-192.168.202.21@tcp:36:touch.500 Request processed in 419us (701us total) trans 8589956721 rc 0/0 00000100:00100000:3.0:1782487585.661178:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26811 00000100:00100000:3.0:1782487585.661183:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213077546245 time 7213082128859 state 0x2 ref 0 00000100:00100000:1.0:1782487585.662658:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294274560 00000100:00100000:3.0:1782487585.662665:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294274304 00000100:00100000:1.0:1782487585.662665:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294274560 00000100:00100000:3.0:1782487585.662670:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294274304 00000100:00100000:3.0:1782487585.662718:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16115 00000100:00100000:1.0:1782487585.662720:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5727 00000100:00100000:3.0:1782487585.662728:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2363:x1869066294274304:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.662736:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+607:294372:x1869066294274560:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.662995:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+607:294372:x1869066294274560:12345-192.168.202.21@tcp:35:touch.500 Request processed in 263us (480us total) trans 8589956722 rc 0/0 00000100:00100000:1.0:1782487585.663003:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5727 00000100:00100000:3.0:1782487585.663011:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2363:x1869066294274304:12345-192.168.202.21@tcp:2:touch.500 Request processed in 283us (546us total) trans 8589940648 rc 0/0 00000100:00100000:3.0:1782487585.663020:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16115 00000100:00100000:3.0:1782487585.663044:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294274816 00000100:00100000:3.0:1782487585.663047:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294274816 00000100:00100000:3.0:1782487585.663065:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213077546245 time 7213082128859 state 0x0 ref 1 00000100:00100000:3.0:1782487585.663075:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213082228859 time 7213082128859 state 0x1 ref 1 00000100:00100000:1.0:1782487585.663084:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294274944 00000100:00100000:1.0:1782487585.663090:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294274944 00000100:00100000:3.0:1782487585.663098:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213082228859 time 7213084487986 state 0x0 ref 1 00000100:00100000:1.0:1782487585.663109:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213084587986 time 7213084487986 state 0x1 ref 2 00000100:00100000:3.0:1782487585.663110:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+608:294376:x1869066294274816:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.663125:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.663137:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213084587986 time 7213084527641 state 0x0 ref 2 00010000:00010000:3.0:1782487585.663140:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b8bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778a5 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.663152:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+609:294373:x1869066294274944:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.663162:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.663177:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b8c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778ac expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.663228:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778ac expref: 610 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.663241:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778ac expref: 610 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.663256:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.663258:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.663261:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551446000, rc 0) 00000100:00100000:1.0:1782487585.663278:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+610:294373:x1869066294274944:12345-192.168.202.21@tcp:101:touch.500 Request processed in 130us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.663285:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26813 00010000:00010000:3.0:1782487585.665225:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.665243:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.665251:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.665264:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.665269:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.665274:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.666053:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1862:0x0], index 0: 0 00010000:00010000:3.0:1782487585.666217:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b8d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666226:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666234:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.666262:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294275200 00010000:00010000:3.0:1782487585.666267:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.666272:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294275200 00010000:00010000:3.0:1782487585.666276:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666284:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666290:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.666294:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666301:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666312:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.666316:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.666320:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.666325:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5728 00010000:00010000:3.0:1782487585.666337:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b8ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.666338:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+611:294368:x1869066294275200:12345-192.168.202.21@tcp:35:touch.500 00000004:00010000:3.0:1782487585.666357:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dae8a3b reply state 000000005a7334a4 transno 8589956723 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.666366:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.666397:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b8bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778a5 expref: 612 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666412:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778a5 expref: 611 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.666419:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb49c365100) 00010000:00010000:3.0:1782487585.666421:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.666423:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54400, rc 0) 00000100:00100000:3.0:1782487585.666485:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+613:294376:x1869066294274816:12345-192.168.202.21@tcp:101:touch.500 Request processed in 3376us (3930us total) trans 8589956723 rc 0/0 00000100:00100000:3.0:1782487585.666494:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26812 00000100:00100000:3.0:1782487585.666501:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213084587986 time 7213084527641 state 0x2 ref 0 00000100:00100000:1.0:1782487585.666530:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+612:294368:x1869066294275200:12345-192.168.202.21@tcp:35:touch.500 Request processed in 193us (998us total) trans 8589956724 rc 0/0 00000100:00100000:1.0:1782487585.666539:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5728 00010000:00010000:3.0:1782487585.667648:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.667650:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294275328 00000100:00100000:1.0:1782487585.667656:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294275328 00010000:00010000:3.0:1782487585.667657:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.667664:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.667672:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.667676:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.667683:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.667695:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb49c365d00) 00010000:00010000:3.0:1782487585.667698:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782487585.667702:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16116 00010000:00010000:3.0:1782487585.667703:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.667714:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+94:2363:x1869066294275328:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487585.667715:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b8d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.667940:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+95:2363:x1869066294275328:12345-192.168.202.21@tcp:2:touch.500 Request processed in 228us (397us total) trans 8589939986 rc 0/0 00000100:00100000:1.0:1782487585.667949:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16116 00000100:00100000:3.0:1782487585.673369:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294275584 00000100:00100000:3.0:1782487585.673380:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294275584 00000100:00100000:3.0:1782487585.673414:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213084587986 time 7213084527641 state 0x0 ref 1 00000100:00100000:3.0:1782487585.673427:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213084627641 time 7213084527641 state 0x1 ref 1 00000100:00100000:3.0:1782487585.673448:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294275840 00000100:00100000:3.0:1782487585.673451:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294275840 00000100:00100000:3.0:1782487585.673476:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213094948681 time 7213094848681 state 0x1 ref 2 00000100:00100000:3.0:1782487585.673490:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213094948681 time 7213094881505 state 0x0 ref 2 00000100:00100000:3.0:1782487585.673498:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+612:294379:x1869066294275840:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.673507:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.673515:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294276096 00000100:00100000:1.0:1782487585.673522:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294276096 00000100:00100000:1.0:1782487585.673559:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5729 00000100:00100000:1.0:1782487585.673571:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+613:294373:x1869066294276096:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487585.673596:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b8e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778b3 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673725:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673734:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673742:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673756:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673763:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.673769:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.673883:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+616:294373:x1869066294276096:12345-192.168.202.21@tcp:35:touch.500 Request processed in 310us (475us total) trans 8589956725 rc 0/0 00000100:00100000:1.0:1782487585.673896:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5729 00000004:00080000:3.0:1782487585.674345:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x183c:0x0], index 1: 0 00010000:00010000:3.0:1782487585.674481:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b902 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674492:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674502:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674856:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674866:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674873:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674880:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.674885:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674893:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674905:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.674908:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.674913:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674919:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b8f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.674931:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d85736aa reply state 000000006a81b656 transno 8589956727 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.674938:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.674964:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b8e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778b3 expref: 616 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674979:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b902 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778b3 expref: 615 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.674992:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb54c47f200) 00010000:00010000:3.0:1782487585.674995:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.674998:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4da00, rc 0) 00000100:00100000:3.0:1782487585.675196:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+615:294379:x1869066294275840:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1587us (1759us total) trans 8589956727 rc 0/0 00000100:00100000:3.0:1782487585.675215:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26815 00000100:00100000:3.0:1782487585.675222:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213094948681 time 7213094881505 state 0x2 ref 0 00000100:00100000:1.0:1782487585.675480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.679142:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679223:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679231:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679238:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.679242:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679251:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679268:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.679272:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.679277:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.679285:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b8fb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.680296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.680364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.680456:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294276608 00000100:00100000:3.0:1782487585.680461:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294276608 00000100:00100000:3.0:1782487585.680482:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213094981505 time 7213097023670 state 0x0 ref 1 00000100:00100000:3.0:1782487585.680494:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213097123670 time 7213097023670 state 0x1 ref 1 00000100:00100000:3.0:1782487585.680569:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213097123670 time 7213101958506 state 0x0 ref 1 00000100:00100000:3.0:1782487585.680581:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+615:294379:x1869066294276608:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.680670:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.680690:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b902 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778b3 expref: 615 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.680704:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb54c47f200) 00010000:00010000:3.0:1782487585.680715:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.680765:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.680777:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.680787:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.680889:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008893393f reply state 00000000aa44260f transno 8589956728 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.680904:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.680960:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+616:294379:x1869066294276608:12345-192.168.202.21@tcp:36:touch.500 Request processed in 380us (595us total) trans 8589956728 rc 0/0 00000100:00100000:3.0:1782487585.680968:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26817 00000100:00100000:3.0:1782487585.680973:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213097123670 time 7213101958506 state 0x2 ref 0 00010000:00010000:1.0:1782487585.685238:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685257:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685266:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685274:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.685279:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685289:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685319:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:1.0:1782487585.685325:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.685331:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.685337:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85b917 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.686449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.687477:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294276992 00000100:00100000:3.0:1782487585.687487:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294276992 00000100:00100000:3.0:1782487585.687540:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5730 00000100:00100000:3.0:1782487585.687551:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+615:294376:x1869066294276992:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.688052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.688096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.688379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.690372:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+618:294376:x1869066294276992:12345-192.168.202.21@tcp:35:touch.500 Request processed in 2818us (3924us total) trans 8589956729 rc 0/0 00000100:00100000:3.0:1782487585.690384:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5730 00000100:00100000:3.0:1782487585.690417:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294277248 00000100:00100000:3.0:1782487585.690423:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294277248 00000100:00100000:3.0:1782487585.690461:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1136 00000100:00100000:3.0:1782487585.690471:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+618:2363:x1869066294277248:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.690505:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.690517:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b941 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778c8 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690870:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690883:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690897:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690913:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690921:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.690929:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691030:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691040:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691048:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.691066:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb26:0x0]: returning size 0 00000004:00200000:3.0:1782487585.691070:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.691086:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691097:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691106:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691117:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691124:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691130:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.691134:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691142:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691154:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.691231:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.691237:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691244:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85b948 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691258:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691266:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691273:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691279:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.691284:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691291:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691301:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb54c47f200) 00010000:00010000:3.0:1782487585.691305:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.691308:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691315:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85b94f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691346:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85b941 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778c8 expref: 620 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691360:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778c8 expref: 619 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691368:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487585.691371:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.691374:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55c00, rc 0) 00010000:00010000:3.0:1782487585.691381:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.691389:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b95d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778cf expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691413:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691421:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691431:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691443:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691450:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691457:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691521:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691595:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691603:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.691638:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb27:0x0]: returning size 0 00000004:00200000:3.0:1782487585.691642:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.691652:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691661:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691669:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691679:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691686:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691692:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.691695:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691805:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691818:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.691821:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.691825:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691831:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85b964 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691843:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691850:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691856:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691862:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.691867:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691874:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691883:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb54c47f000) 00010000:00010000:3.0:1782487585.691885:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.691888:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691894:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54400/0x66475b4e8b85b96b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691921:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85b95d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778cf expref: 621 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691933:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85b972 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778cf expref: 620 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691941:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb27:0x0].0x0 (ffff9cb5481d9500) 00010000:00010000:3.0:1782487585.691944:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.691947:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54800, rc 0) 00010000:00010000:3.0:1782487585.691953:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.691961:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b979 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778d6 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691986:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.691994:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692004:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692016:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692024:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692032:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692097:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692107:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692116:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.692130:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb28:0x0]: returning size 0 00000004:00200000:3.0:1782487585.692133:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.692144:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692153:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692231:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692241:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692247:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692252:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.692256:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692263:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692273:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.692276:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.692280:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692285:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85b980 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692297:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692304:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692310:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692316:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.692319:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692326:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692335:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb45539c300) 00010000:00010000:3.0:1782487585.692338:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.692341:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692347:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85b987 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692372:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85b979 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778d6 expref: 622 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692386:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778d6 expref: 621 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692393:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4664e1500) 00010000:00010000:3.0:1782487585.692396:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.692399:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00010000:00010000:3.0:1782487585.692404:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.692413:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b995 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778dd expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692440:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692448:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692456:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692470:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692477:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692484:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.692779:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294277376 00000100:00100000:1.0:1782487585.692785:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294277376 00010000:00010000:3.0:1782487585.692852:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692862:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.692865:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294277504 00000100:00100000:1.0:1782487585.692869:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294277504 00010000:00010000:3.0:1782487585.692870:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.692884:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2b:0x0]: returning size 0 00000004:00200000:3.0:1782487585.692888:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.692898:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692908:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692915:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692925:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692931:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692937:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.692940:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692946:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692956:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.692958:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.692962:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692967:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85b99c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692979:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692985:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692991:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.692997:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.693001:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693006:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693015:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb45539cd00) 00010000:00010000:3.0:1782487585.693018:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.693021:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693027:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85b9a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693052:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85b995 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778dd expref: 623 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693065:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778dd expref: 622 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693071:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.693074:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.693076:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac000, rc 0) 00010000:00010000:3.0:1782487585.693081:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.693089:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85b9b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778e4 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693111:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693119:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693127:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693139:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693145:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693153:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693291:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693300:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693308:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.693322:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.693331:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693340:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693347:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693353:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693361:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693366:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.693370:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693377:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693386:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.693389:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.693393:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693399:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85b9b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693410:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693416:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693423:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693429:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4aee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.693433:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693443:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693452:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb45539c600) 00010000:00010000:3.0:1782487585.693455:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.693459:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693465:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4aee00/0x66475b4e8b85b9bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693492:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85b9b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778e4 expref: 624 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693506:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778e4 expref: 623 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693513:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb558966b00) 00010000:00010000:3.0:1782487585.693516:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.693518:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00010000:00010000:3.0:1782487585.693875:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.693886:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85b9d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4778eb expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693912:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693921:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693930:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693944:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693952:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693960:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.693995:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694003:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694009:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694014:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.694018:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694024:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694035:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.694038:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.694041:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694047:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae200/0x66475b4e8b85b9db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694058:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694065:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694071:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694077:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.694080:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694087:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694095:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.694098:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.694101:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694108:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85b9e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694242:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85b9d4 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778eb expref: 624 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694259:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.694262:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.694266:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae600/0x66475b4e8b85b9d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778eb expref: 624 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.694277:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae600, rc -2) 00000100:00100000:3.0:1782487585.694315:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+624:2363:x1869066294277248:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 3846us (6220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487585.694324:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1136 00010000:00010000:1.0:1782487585.696573:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696582:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696589:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696595:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0de00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.696600:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696811:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696826:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb5481d9e00) 00010000:00010000:1.0:1782487585.696830:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.696834:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.696841:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0de00/0x66475b4e8b85b9f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.697320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.697402:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294278016 00000100:00100000:1.0:1782487585.697410:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294278016 00000100:00100000:1.0:1782487585.697489:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5731 00000100:00100000:1.0:1782487585.697500:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+625:294379:x1869066294278016:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.697892:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+626:294379:x1869066294278016:12345-192.168.202.21@tcp:35:touch.500 Request processed in 393us (573us total) trans 8589956731 rc 0/0 00000100:00100000:1.0:1782487585.697901:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5731 00000100:00100000:3.0:1782487585.698426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.698455:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294278272 00000100:00100000:3.0:1782487585.698460:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294278272 00000100:00100000:3.0:1782487585.698481:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213109944270 time 7213115746528 state 0x0 ref 1 00000100:00100000:3.0:1782487585.698493:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213115846528 time 7213115746528 state 0x1 ref 1 00000100:00100000:3.0:1782487585.698517:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213115846528 time 7213119906783 state 0x0 ref 1 00000100:00100000:3.0:1782487585.698542:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+626:294381:x1869066294278272:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.698574:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.698594:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85b9fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47790e expref: 626 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.698627:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2d:0x0].0x0 (ffff9cb5588ee800) 00010000:00010000:3.0:1782487585.698638:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.698802:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.698815:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.698825:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.698910:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006af44843 reply state 000000009829d8dc transno 8589956732 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.698919:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.698974:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+627:294381:x1869066294278272:12345-192.168.202.21@tcp:36:touch.500 Request processed in 433us (549us total) trans 8589956732 rc 0/0 00000100:00100000:3.0:1782487585.698982:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26821 00000100:00100000:3.0:1782487585.698988:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213115846528 time 7213119906783 state 0x2 ref 0 00000100:00100000:3.0:1782487585.700277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.700939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.701814:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701823:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701830:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701836:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4ae800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.701841:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701848:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701861:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2d:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487585.701864:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.701869:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.701875:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4ae800/0x66475b4e8b85ba0c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.706487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.706687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.706890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.706969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.707009:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294278784 00000100:00100000:3.0:1782487585.707017:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294278784 00000100:00100000:3.0:1782487585.707064:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294278912 00000100:00100000:3.0:1782487585.707067:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294278912 00000100:00100000:3.0:1782487585.707092:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294279168 00000100:00100000:3.0:1782487585.707096:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294279168 00000100:00100000:3.0:1782487585.707124:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16120 00000100:00100000:3.0:1782487585.707135:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2363:x1869066294278784:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.707154:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.707175:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477923 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.707201:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1839:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.707230:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.707235:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.707245:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 98 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.707266:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 98 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.707280:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae200, rc 0) 00000100:00100000:3.0:1782487585.707335:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2363:x1869066294278784:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 201us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.707344:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16120 00000100:00100000:3.0:1782487585.707368:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16121 00000100:00100000:3.0:1782487585.707377:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2362:x1869066294278912:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.707386:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.707398:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47792a expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.707414:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1860:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.707425:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.707429:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.707435:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 122 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.707447:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 122 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.707456:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae600, rc 0) 00000100:00100000:3.0:1782487585.707474:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2362:x1869066294278912:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 100us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.707480:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16121 00000100:00100000:3.0:1782487585.707493:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16122 00000100:00100000:3.0:1782487585.707499:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2362:x1869066294279168:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.707506:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.707515:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477931 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707827:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707837:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707844:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707851:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.707856:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707864:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707879:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb49c365f00) 00010000:00010000:1.0:1782487585.707883:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.707887:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.707893:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.708804:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x183a:0x0] initial LVB size: 0, mtime: 0x6a3e9a21, atime: 0x6a3e9a21, ctime: 0x6a3e9a21, blocks: 0x1 00010000:00010000:3.0:1782487585.708820:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.708824:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.708832:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 98 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.708848:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 98 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.708864:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4aee00, rc 0) 00000100:00100000:3.0:1782487585.708896:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2362:x1869066294279168:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 1396us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.708903:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16122 00000100:00100000:3.0:1782487585.708964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.709033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.709099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.709234:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294279040 00000100:00100000:3.0:1782487585.709239:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294279040 00000100:00100000:3.0:1782487585.709267:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294279680 00000100:00100000:3.0:1782487585.709269:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294279680 00000100:00100000:3.0:1782487585.709291:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16124 00000100:00100000:3.0:1782487585.709298:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2362:x1869066294279552:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.709305:0:213211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.709318:0:213211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477938 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.709334:0:213211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1862:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.709344:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.709348:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.709356:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 124 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.709370:0:213211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 124 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.709384:0:213211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4ae800, rc 0) 00000100:00100000:3.0:1782487585.709411:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2362:x1869066294279552:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.709418:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16124 00000100:00100000:3.0:1782487585.709436:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16125 00000100:00100000:3.0:1782487585.709444:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2362:x1869066294279680:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.709451:0:213211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.709463:0:213211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47793f expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.709475:0:213211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x183c:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.709484:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.709488:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.709494:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 99 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.709506:0:213211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 99 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.709515:0:213211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0de00, rc 0) 00000100:00100000:3.0:1782487585.710827:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2362:x1869066294279680:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 1379us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.710835:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16125 00010000:00010000:1.0:1782487585.713195:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713213:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713221:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713227:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.713232:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713240:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713253:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4b6109300) 00010000:00010000:1.0:1782487585.713256:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.713260:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713266:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85ba52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.713493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.713601:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713665:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713672:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713678:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.713683:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.713690:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.713844:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294280064 00000100:00100000:3.0:1782487585.713850:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294280064 00000100:00100000:3.0:1782487585.713875:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213130242949 time 7213132515556 state 0x0 ref 1 00000100:00100000:3.0:1782487585.713885:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213132615556 time 7213132515556 state 0x1 ref 1 00000100:00100000:3.0:1782487585.713907:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213132615556 time 7213135298340 state 0x0 ref 1 00000100:00100000:3.0:1782487585.713919:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+632:294405:x1869066294280064:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.713935:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.713949:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ba8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47794d expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.713989:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ba8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47794d expref: 633 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.714002:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ba8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47794d expref: 633 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.714034:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4b6109600) 00010000:00010000:1.0:1782487585.714038:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.714042:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.714048:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ba75 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.714100:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487585.714104:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.714107:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0ce00, rc 0) 00000100:00100000:3.0:1782487585.714148:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+632:294405:x1869066294280064:12345-192.168.202.21@tcp:101:touch.500 Request processed in 230us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.714155:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26826 00000100:00100000:3.0:1782487585.714160:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213132615556 time 7213135298340 state 0x2 ref 0 00000100:00100000:3.0:1782487585.714455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.714598:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294280320 00000100:00100000:1.0:1782487585.714603:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294280320 00000100:00100000:1.0:1782487585.714813:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5732 00000100:00100000:1.0:1782487585.714822:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+632:294381:x1869066294280320:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.715090:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+633:294381:x1869066294280320:12345-192.168.202.21@tcp:35:touch.500 Request processed in 268us (636us total) trans 8589956736 rc 0/0 00000100:00100000:1.0:1782487585.715099:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5732 00000100:00100000:3.0:1782487585.717421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.717460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.717485:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294280576 00000100:00100000:3.0:1782487585.717491:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294280576 00000100:00100000:3.0:1782487585.717514:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213132615556 time 7213135298340 state 0x0 ref 1 00000100:00100000:3.0:1782487585.717524:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213135398340 time 7213135298340 state 0x1 ref 1 00000100:00100000:3.0:1782487585.717546:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294280832 00000100:00100000:3.0:1782487585.717549:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294280832 00000100:00100000:3.0:1782487585.717564:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213135398340 time 7213135298340 state 0x1 ref 2 00000100:00100000:3.0:1782487585.717586:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213139076697 time 7213138976697 state 0x1 ref 2 00000100:00100000:3.0:1782487585.717596:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+634:294385:x1869066294280576:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.717664:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.717693:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85ba7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477946 expref: 634 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.717712:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:3.0:1782487585.717724:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.717790:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.717804:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.717814:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.717933:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000daa7af3c reply state 000000005fa9564e transno 8589956737 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.717942:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.718013:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+635:294385:x1869066294280576:12345-192.168.202.21@tcp:36:touch.500 Request processed in 416us (599us total) trans 8589956737 rc 0/0 00000100:00100000:3.0:1782487585.718022:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26827 00000100:00100000:3.0:1782487585.718042:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213139076697 time 7213139433100 state 0x0 ref 1 00000100:00100000:3.0:1782487585.718051:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+634:294406:x1869066294280832:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.718058:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.718066:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477954 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718146:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718154:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718171:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718182:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718187:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718192:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.718577:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x183e:0x0], index 1: 0 00010000:00010000:3.0:1782487585.718770:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85baad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718780:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85baad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718789:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85baad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718820:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718826:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718831:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718835:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.718838:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718844:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718852:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.718854:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.718857:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718864:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85ba9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.718873:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ee4d27e reply state 00000000e6e54427 transno 8589956738 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.718878:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.718896:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ba98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477954 expref: 637 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718906:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85baad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477954 expref: 636 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.718911:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.718913:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.718915:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715aca00, rc 0) 00000100:00100000:3.0:1782487585.718939:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+637:294406:x1869066294280832:12345-192.168.202.21@tcp:101:touch.500 Request processed in 890us (1480us total) trans 8589956738 rc 0/0 00000100:00100000:3.0:1782487585.718945:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26828 00000100:00100000:3.0:1782487585.718949:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213139076697 time 7213139433100 state 0x2 ref 0 00010000:00010000:1.0:1782487585.720455:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.720465:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.720472:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.720478:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deaa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.720482:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.720483:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294280960 00000100:00100000:3.0:1782487585.720489:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294280960 00010000:00010000:1.0:1782487585.720490:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.720501:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:1.0:1782487585.720504:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.720508:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.720514:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deaa00/0x66475b4e8b85ba91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.720534:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16126 00000100:00100000:3.0:1782487585.720544:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2361:x1869066294280960:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.721088:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2361:x1869066294280960:12345-192.168.202.21@tcp:2:touch.500 Request processed in 543us (831us total) trans 8589939988 rc 0/0 00000100:00100000:3.0:1782487585.721100:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16126 00010000:00010000:1.0:1782487585.721159:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721168:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721175:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721181:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.721184:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721191:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721202:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.721273:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.721278:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.721285:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af800/0x66475b4e8b85baa6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.723256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.723502:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294281600 00000100:00100000:3.0:1782487585.723508:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294281600 00000100:00100000:3.0:1782487585.723530:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213143154285 time 7213143234504 state 0x0 ref 1 00000100:00100000:3.0:1782487585.723540:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213143334504 time 7213143234504 state 0x1 ref 1 00000100:00100000:3.0:1782487585.723563:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213143334504 time 7213144952701 state 0x0 ref 1 00000100:00100000:3.0:1782487585.723576:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+639:294406:x1869066294281600:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.723733:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.723751:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85baad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477954 expref: 639 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.723765:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.723774:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.723827:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.723838:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.723847:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.723933:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000436fd9eb reply state 00000000312daf4a transno 8589956740 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.723946:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.724243:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+640:294406:x1869066294281600:12345-192.168.202.21@tcp:36:touch.500 Request processed in 669us (987us total) trans 8589956740 rc 0/0 00000100:00100000:3.0:1782487585.724251:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26831 00000100:00100000:3.0:1782487585.724256:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213143334504 time 7213144952701 state 0x2 ref 0 00010000:00010000:1.0:1782487585.724378:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724387:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724394:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724400:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.724405:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724412:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724423:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4c4bb4700) 00010000:00010000:1.0:1782487585.724426:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.724430:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.724436:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bad0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.724466:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294281856 00000100:00100000:1.0:1782487585.724471:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294281856 00000100:00100000:1.0:1782487585.724963:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5733 00000100:00100000:1.0:1782487585.724973:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442f73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+639:294405:x1869066294281856:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.725348:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442f73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+640:294405:x1869066294281856:12345-192.168.202.21@tcp:35:touch.500 Request processed in 376us (905us total) trans 8589956741 rc 0/0 00000100:00100000:1.0:1782487585.725357:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5733 00000100:00100000:1.0:1782487585.725508:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294281984 00000100:00100000:1.0:1782487585.725512:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294281984 00000100:00100000:3.0:1782487585.725575:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294282112 00000100:00100000:3.0:1782487585.725580:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294282112 00000100:00100000:3.0:1782487585.725599:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213143334504 time 7213144952701 state 0x0 ref 1 00000100:00100000:3.0:1782487585.725626:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213145052701 time 7213144952701 state 0x1 ref 1 00000100:00100000:3.0:1782487585.725645:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294282496 00000100:00100000:3.0:1782487585.725649:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294282496 00000100:00100000:3.0:1782487585.725664:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213145052701 time 7213144952701 state 0x1 ref 2 00000100:00100000:3.0:1782487585.725682:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 2 00000100:00100000:3.0:1782487585.725693:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+641:294386:x1869066294282112:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.725706:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.725718:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85baec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477969 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725761:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725774:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725787:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725802:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725810:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.725818:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.725929:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16127 00000100:00100000:1.0:1782487585.725940:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2363:x1869066294281984:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487585.725996:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726056:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726065:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.726092:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb26:0x0]: returning size 0 00000004:00200000:3.0:1782487585.726096:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.726109:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726118:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726124:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726132:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726139:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726146:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.726150:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726163:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.726167:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2363:x1869066294281984:12345-192.168.202.21@tcp:2:touch.500 Request processed in 228us (686us total) trans 8589940651 rc 0/0 00000100:00100000:1.0:1782487585.726181:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16127 00010000:00010000:3.0:1782487585.726187:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.726192:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.726196:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726203:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85baf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726234:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726242:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726243:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726265:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726265:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726282:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726288:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.726291:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726298:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726309:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4549e8900) 00010000:00010000:1.0:1782487585.726312:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.726317:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.726325:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85bae5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726329:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.726335:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726350:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726362:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4549e8d00) 00010000:00010000:3.0:1782487585.726365:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.726370:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726377:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85bafa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726425:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85baec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477969 expref: 644 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726456:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bb01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477969 expref: 643 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726465:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487585.726472:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.726477:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57edff600, rc 0) 00000100:00100000:3.0:1782487585.726513:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+643:294386:x1869066294282112:12345-192.168.202.21@tcp:101:rm.500 Request processed in 821us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.726519:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26832 00000100:00100000:3.0:1782487585.726534:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294282240 00000100:00100000:3.0:1782487585.726538:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294282240 00000100:00100000:3.0:1782487585.726553:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 2 00000100:00100000:3.0:1782487585.726575:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294282752 00000100:00100000:3.0:1782487585.726578:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294282752 00000100:00100000:3.0:1782487585.726604:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 3 00000100:00100000:3.0:1782487585.726638:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294282880 00000100:00100000:3.0:1782487585.726644:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294282880 00000100:00100000:3.0:1782487585.726671:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 4 00000100:00100000:3.0:1782487585.726689:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294283008 00000100:00100000:3.0:1782487585.726695:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294283008 00000100:00100000:3.0:1782487585.726710:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 5 00000100:00100000:3.0:1782487585.726720:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294283136 00000100:00100000:3.0:1782487585.726724:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294283136 00000100:00100000:3.0:1782487585.726735:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 6 00000100:00100000:3.0:1782487585.726748:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294283264 00000100:00100000:3.0:1782487585.726751:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294283264 00000100:00100000:3.0:1782487585.726761:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 7 00000100:00100000:3.0:1782487585.726769:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294283392 00000100:00100000:3.0:1782487585.726772:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294283392 00000100:00100000:3.0:1782487585.726787:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213147172982 time 7213147072982 state 0x1 ref 8 00000100:00100000:3.0:1782487585.726806:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213148295399 time 7213148195399 state 0x1 ref 8 00000100:00100000:3.0:1782487585.726822:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+648:294387:x1869066294282496:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.726850:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.726869:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85bad7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477962 expref: 647 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726890:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb4b6109600) 00010000:00010000:3.0:1782487585.726901:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.726944:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726951:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.726956:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.727197:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002269eaff reply state 000000006712f828 transno 8589956742 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.727220:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.727413:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+649:294387:x1869066294282496:12345-192.168.202.21@tcp:36:touch.500 Request processed in 458us (1992us total) trans 8589956742 rc 0/0 00000100:00100000:3.0:1782487585.727427:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26833 00000100:00100000:3.0:1782487585.727453:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213148942965 time 7213148842965 state 0x1 ref 6 00000100:00100000:3.0:1782487585.727473:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+647:294390:x1869066294282880:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.727485:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.727497:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85bb47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477985 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727534:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727561:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727571:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727791:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.727808:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213149296089 time 7213149196089 state 0x1 ref 6 00010000:00010000:3.0:1782487585.727812:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.727824:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+649:294407:x1869066294283008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.727836:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727837:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.727848:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bb71 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47798c expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727881:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727889:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727898:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727909:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727914:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727920:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727925:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727930:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.727936:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.727962:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb28:0x0]: returning size 0 00000004:00200000:3.0:1782487585.727968:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.727984:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.727994:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728006:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728018:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728030:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728031:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728048:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.728050:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728053:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728065:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728068:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728083:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000004:00200000:1.0:1782487585.728087:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2c:0x0]: returning size 0 00010000:00010000:3.0:1782487585.728088:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:1.0:1782487585.728091:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487585.728094:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.728103:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728105:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bb55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728121:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728125:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728135:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728152:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728154:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728165:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728174:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.728179:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728180:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728195:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.728200:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728203:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728218:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728238:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.728240:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.728242:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4549e8e00) 00010000:00010000:1.0:1782487585.728244:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728249:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.728255:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728256:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bb78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728274:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85bb63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728282:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728290:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728297:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728303:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.728307:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85bb47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477985 expref: 651 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728309:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728325:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728337:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.728338:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85bb7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477985 expref: 650 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728342:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.728347:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728357:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4664e1500) 00010000:00010000:1.0:1782487585.728359:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bb86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728365:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.728371:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc 0) 00010000:00010000:1.0:1782487585.728399:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bb71 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47798c expref: 651 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.728401:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+651:294390:x1869066294282880:12345-192.168.202.21@tcp:101:rm.500 Request processed in 929us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.728421:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26836 00010000:00010000:1.0:1782487585.728422:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47798c expref: 650 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728432:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb558966b00) 00010000:00010000:1.0:1782487585.728435:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.728438:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fc71800, rc 0) 00000100:00100000:3.0:1782487585.728447:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213149936067 time 7213149836067 state 0x1 ref 4 00000100:00100000:1.0:1782487585.728463:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+649:294407:x1869066294283008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 643us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.728472:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+649:294394:x1869066294283264:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487585.728473:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26837 00010000:00010000:3.0:1782487585.728491:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.728497:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213149936067 time 7213149887303 state 0x0 ref 3 00010000:00010000:3.0:1782487585.728504:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85bbb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47799a expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.728510:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+648:294406:x1869066294283392:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.728534:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.728553:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85bbb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4779a1 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728563:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728576:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728585:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85bbb7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779a1 expref: 651 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728597:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85bbb7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779a1 expref: 650 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.728633:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487585.728636:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.728638:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4da00, rc 0) 00000100:00100000:1.0:1782487585.728656:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+650:294406:x1869066294283392:12345-192.168.202.21@tcp:101:touch.500 Request processed in 150us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.728666:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26840 00010000:00010000:3.0:1782487585.728821:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728838:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728846:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728858:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728922:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728932:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728941:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.728966:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2a:0x0]: returning size 0 00000004:00200000:3.0:1782487585.728969:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.728980:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728991:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.728999:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729007:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729016:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729026:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.729032:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729048:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729058:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.729062:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.729067:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729079:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bbbe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729098:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729107:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729115:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729123:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.729130:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729147:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729169:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb4549e8300) 00010000:00010000:3.0:1782487585.729172:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.729176:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729183:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bbc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729452:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85bbb0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 652 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729471:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 651 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.729485:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:3.0:1782487585.729487:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.729490:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55800, rc 0) 00000100:00100000:3.0:1782487585.729526:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+651:294394:x1869066294283264:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1059us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.729536:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26839 00000100:00100000:3.0:1782487585.729547:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213149936067 time 7213149887303 state 0x2 ref 0 00000100:00100000:3.0:1782487585.729583:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294283904 00000100:00100000:3.0:1782487585.729854:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294283904 00000100:00100000:3.0:1782487585.729899:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5734 00000100:00100000:3.0:1782487585.729910:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+652:294385:x1869066294283904:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487585.729951:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.729958:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.729964:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.729970:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.730032:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.730040:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.730050:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487585.730052:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.730056:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.730061:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85bb1d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.730293:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+653:294385:x1869066294283904:12345-192.168.202.21@tcp:35:touch.500 Request processed in 384us (1350us total) trans 8589956743 rc 0/0 00000100:00100000:3.0:1782487585.730302:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5734 00000100:00100000:1.0:1782487585.730826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.733508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.733550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.733587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.733638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.733679:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294284160 00000100:00100000:1.0:1782487585.733685:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294284160 00000100:00100000:3.0:1782487585.733686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.733718:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294284672 00000100:00100000:3.0:1782487585.733724:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294284672 00000100:00100000:1.0:1782487585.733787:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294284544 00000100:00100000:1.0:1782487585.733791:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294284544 00000100:00100000:3.0:1782487585.734031:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1150 00000100:00100000:3.0:1782487585.734043:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+657:2363:x1869066294284160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.734054:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487585.734065:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1151 00010000:00010000:3.0:1782487585.734076:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7e00/0x66475b4e8b85bb39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477970 expref: 657 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.734077:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+657:2360:x1869066294284672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487585.734089:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.734103:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb27:0x0].0x0 (ffff9cb5481d9500) 00010000:00010000:1.0:1782487585.734105:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bb8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47798c expref: 656 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.734110:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.734124:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb558966b00) 00010000:00010000:1.0:1782487585.734128:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.734138:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+655:2363:x1869066294284160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 97us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.734147:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1150 00000100:00100000:1.0:1782487585.734156:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+655:2360:x1869066294284672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 81us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.734166:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1151 00000100:00100000:3.0:1782487585.734175:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1152 00000100:00100000:3.0:1782487585.734185:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+653:2360:x1869066294284544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.734195:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.734223:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85bb6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47797e expref: 653 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.734237:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb558966700) 00010000:00010000:3.0:1782487585.734241:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.734267:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+652:2360:x1869066294284544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 81us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.734277:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1152 00000100:00100000:1.0:1782487585.734300:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294284928 00000100:00100000:1.0:1782487585.734305:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294284928 00000100:00100000:1.0:1782487585.734339:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16130 00000100:00100000:1.0:1782487585.734348:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2362:x1869066294284928:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.734802:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2362:x1869066294284928:12345-192.168.202.21@tcp:2:touch.500 Request processed in 453us (536us total) trans 8589939989 rc 0/0 00000100:00100000:1.0:1782487585.734811:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16130 00000100:00100000:3.0:1782487585.735043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.735075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.735549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.735686:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294285312 00000100:00100000:1.0:1782487585.735691:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294285312 00000100:00100000:1.0:1782487585.735710:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213149987303 time 7213153176212 state 0x0 ref 1 00000100:00100000:1.0:1782487585.735721:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213153276212 time 7213153176212 state 0x1 ref 1 00000100:00100000:1.0:1782487585.735744:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213153276212 time 7213157134232 state 0x0 ref 1 00000100:00100000:1.0:1782487585.735756:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4d221a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+651:294389:x1869066294285312:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.735770:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.735782:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85bcac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4779ee expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735887:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735899:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735909:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735923:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735931:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.735938:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487585.736409:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x183f:0x0], index 1: 0 00000100:00100000:3.0:1782487585.736743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.736777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.736824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.736849:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294285696 00000100:00100000:3.0:1782487585.736854:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294285696 00000100:00100000:3.0:1782487585.736897:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16132 00000100:00100000:3.0:1782487585.736950:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2361:x1869066294285696:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.736961:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.736974:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4779f5 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.736993:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1865:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.737006:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.737010:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.737018:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 128 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.737032:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 128 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.737044:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54400, rc 0) 00000100:00100000:3.0:1782487585.737080:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb575e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2361:x1869066294285696:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 174us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.737088:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16132 00000100:00100000:3.0:1782487585.737115:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294285568 00000100:00100000:3.0:1782487585.737119:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294285568 00000100:00100000:3.0:1782487585.737147:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294285952 00000100:00100000:3.0:1782487585.737150:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294285952 00000100:00100000:3.0:1782487585.737173:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5735 00000100:00100000:3.0:1782487585.737182:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+655:294406:x1869066294285568:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.737412:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+656:294406:x1869066294285568:12345-192.168.202.21@tcp:35:touch.500 Request processed in 230us (669us total) trans 8589956745 rc 0/0 00000100:00100000:3.0:1782487585.737420:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5735 00000100:00100000:3.0:1782487585.737438:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5736 00000100:00100000:3.0:1782487585.737446:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+655:294387:x1869066294285952:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.737626:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+656:294387:x1869066294285952:12345-192.168.202.21@tcp:35:touch.500 Request processed in 162us (784us total) trans 8589956746 rc 0/0 00000100:00100000:3.0:1782487585.737634:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5736 00010000:00010000:1.0:1782487585.737778:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bcc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737790:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737799:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737826:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737833:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737898:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737905:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.737909:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737917:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737927:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.737930:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.737934:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.737994:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.738008:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a82e4a7 reply state 00000000ee3266c8 transno 8589956744 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.738016:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.738046:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85bcac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779ee expref: 656 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.738063:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779ee expref: 655 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.738070:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.738073:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.738075:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558d86800, rc 0) 00000100:00100000:1.0:1782487585.738106:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4d221a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+656:294389:x1869066294285312:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2353us (2558us total) trans 8589956744 rc 0/0 00000100:00100000:1.0:1782487585.738114:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26842 00000100:00100000:1.0:1782487585.738120:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213153276212 time 7213157134232 state 0x2 ref 0 00010000:00010000:1.0:1782487585.740163:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740177:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740184:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740190:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.740194:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740202:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740233:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487585.740237:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.740241:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.740248:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bcba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.740917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.741133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.741174:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294286208 00000100:00100000:3.0:1782487585.741181:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294286208 00000100:00100000:3.0:1782487585.741222:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213153276212 time 7213157134232 state 0x0 ref 1 00000100:00100000:3.0:1782487585.741236:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213157234232 time 7213157134232 state 0x1 ref 1 00000100:00100000:3.0:1782487585.741261:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294286464 00000100:00100000:3.0:1782487585.741264:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294286464 00000100:00100000:3.0:1782487585.741280:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213157234232 time 7213157134232 state 0x1 ref 2 00000100:00100000:3.0:1782487585.741314:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213162803589 time 7213162703589 state 0x1 ref 2 00000100:00100000:3.0:1782487585.741329:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+656:294389:x1869066294286208:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487585.741343:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213162803589 time 7213162730979 state 0x0 ref 2 00000100:00100000:1.0:1782487585.741358:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+656:294397:x1869066294286464:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.741378:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.741394:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85bcd6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4779fc expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.741459:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.741478:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bcc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779ee expref: 657 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.741507:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487585.741519:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.741522:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.741537:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.741546:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.741561:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.741568:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.741574:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.741576:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.741591:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.741602:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.742200:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabbac9e reply state 0000000009265196 transno 8589956747 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.742224:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1782487585.742259:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1866:0x0], index 0: 0 00000100:00100000:3.0:1782487585.742314:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+658:294389:x1869066294286208:12345-192.168.202.21@tcp:36:touch.500 Request processed in 989us (1399us total) trans 8589956747 rc 0/0 00000100:00100000:3.0:1782487585.742324:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26843 00010000:00010000:1.0:1782487585.742413:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bcf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742423:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742432:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742461:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742469:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742475:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742481:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.742486:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742493:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742503:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.742506:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.742509:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742519:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85bcdd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.742530:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000059c57d6 reply state 00000000c4921f65 transno 8589956748 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.742537:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.742562:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85bcd6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779fc expref: 659 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742576:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779fc expref: 658 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.742861:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:1.0:1782487585.742866:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.742870:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551447c00, rc 0) 00000100:00100000:1.0:1782487585.742907:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+659:294397:x1869066294286464:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1553us (1776us total) trans 8589956748 rc 0/0 00000100:00100000:1.0:1782487585.742915:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26844 00000100:00100000:1.0:1782487585.742921:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213162803589 time 7213162730979 state 0x2 ref 0 00010000:00010000:1.0:1782487585.744799:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744814:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744822:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744828:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.744834:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744842:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744857:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:1.0:1782487585.744861:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.744865:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.744872:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bceb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.744984:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745032:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745040:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745046:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.745050:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745058:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745070:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.745073:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.745077:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.745084:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bce4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.745353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.746488:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294286848 00000100:00100000:3.0:1782487585.746493:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294286848 00000100:00100000:3.0:1782487585.746513:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213162830979 time 7213166870685 state 0x0 ref 1 00000100:00100000:3.0:1782487585.746522:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213166970685 time 7213166870685 state 0x1 ref 1 00000100:00100000:3.0:1782487585.746550:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213166970685 time 7213167940555 state 0x0 ref 1 00000100:00100000:3.0:1782487585.746562:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+658:294397:x1869066294286848:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.746629:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.746649:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bcf2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779fc expref: 658 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.746664:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb57f753000) 00010000:00010000:3.0:1782487585.746674:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.746723:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bd07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.746732:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bd07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.746741:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bd07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.746852:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015bcea9e reply state 000000005df1e934 transno 8589956749 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85bd07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.746859:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.746908:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+659:294397:x1869066294286848:12345-192.168.202.21@tcp:36:touch.500 Request processed in 350us (556us total) trans 8589956749 rc 0/0 00000100:00100000:3.0:1782487585.746914:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26846 00000100:00100000:3.0:1782487585.746918:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213166970685 time 7213167940555 state 0x2 ref 0 00000100:00100000:3.0:1782487585.747519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.747583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.747634:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294287232 00000100:00100000:1.0:1782487585.747639:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294287232 00000100:00100000:1.0:1782487585.747687:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16133 00000100:00100000:1.0:1782487585.747700:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2363:x1869066294287232:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.747970:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2363:x1869066294287232:12345-192.168.202.21@tcp:2:touch.500 Request processed in 272us (386us total) trans 8589939990 rc 0/0 00000100:00100000:1.0:1782487585.747979:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16133 00000100:00100000:1.0:1782487585.751838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.751917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.753040:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294287360 00000100:00100000:1.0:1782487585.753050:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294287360 00010000:00010000:3.0:1782487585.753061:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.753070:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.753076:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.753084:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213168040555 time 7213169036454 state 0x0 ref 1 00010000:00010000:3.0:1782487585.753085:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.753092:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.753110:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213169136454 time 7213169036454 state 0x1 ref 1 00010000:00010000:3.0:1782487585.753113:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.753128:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c5d1ac00) 00010000:00010000:3.0:1782487585.753132:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.753136:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.753142:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd1c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.753145:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213169136454 time 7213174533732 state 0x0 ref 1 00000100:00100000:1.0:1782487585.753167:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+661:294397:x1869066294287360:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:3.0:1782487585.753188:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294287616 00010000:00010000:1.0:1782487585.753190:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.753194:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294287616 00010000:00010000:1.0:1782487585.753224:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bd31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a11 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.753254:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5737 00000100:00100000:3.0:1782487585.753264:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+662:294389:x1869066294287616:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487585.753280:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bd31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a11 expref: 662 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.753295:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bd31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a11 expref: 662 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.753315:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.753319:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.753322:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551447e00, rc 0) 00000100:00100000:1.0:1782487585.753378:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+662:294397:x1869066294287360:12345-192.168.202.21@tcp:101:touch.500 Request processed in 217us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.753388:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26848 00000100:00100000:1.0:1782487585.753394:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213169136454 time 7213174533732 state 0x2 ref 0 00000100:00100000:3.0:1782487585.753785:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+662:294389:x1869066294287616:12345-192.168.202.21@tcp:35:touch.500 Request processed in 523us (1868us total) trans 8589956751 rc 0/0 00000100:00100000:3.0:1782487585.753792:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5737 00000100:00100000:1.0:1782487585.753970:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213174633732 time 7213175357469 state 0x0 ref 1 00000100:00100000:1.0:1782487585.753986:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+663:294393:x1869066294288128:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.754027:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.754047:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85bd23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a0a expref: 663 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.754064:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:1.0:1782487585.754074:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.754130:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bd3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.754141:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bd3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.754150:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bd3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.754260:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd2778f3 reply state 0000000059440131 transno 8589956752 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85bd3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.754269:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.754323:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+665:294393:x1869066294288128:12345-192.168.202.21@tcp:36:touch.500 Request processed in 341us (600us total) trans 8589956752 rc 0/0 00000100:00100000:1.0:1782487585.754332:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26849 00000100:00100000:3.0:1782487585.757360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.757397:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294288256 00000100:00100000:3.0:1782487585.757404:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294288256 00000100:00100000:3.0:1782487585.757427:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213175457469 time 7213175402899 state 0x0 ref 1 00000100:00100000:3.0:1782487585.757438:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213175502899 time 7213175402899 state 0x1 ref 1 00000100:00100000:3.0:1782487585.757461:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213175502899 time 7213178851255 state 0x0 ref 1 00000100:00100000:3.0:1782487585.757475:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+665:294393:x1869066294288256:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.757495:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.757510:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bd62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a1f expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.757553:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bd62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a1f expref: 666 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.757567:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bd62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a1f expref: 666 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.757582:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:3.0:1782487585.757585:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.757589:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54600, rc 0) 00000100:00100000:3.0:1782487585.757668:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+666:294393:x1869066294288256:12345-192.168.202.21@tcp:101:touch.500 Request processed in 195us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.757677:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26851 00000100:00100000:3.0:1782487585.757683:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213175502899 time 7213178851255 state 0x2 ref 0 00010000:00010000:3.0:1782487585.759770:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759782:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759790:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759797:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.759802:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759811:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759825:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb54b105000) 00010000:00010000:3.0:1782487585.759828:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.759832:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.759839:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bd4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.760604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.760785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.760882:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294288768 00000100:00100000:1.0:1782487585.760886:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294288768 00000100:00100000:1.0:1782487585.760909:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213175502899 time 7213178851255 state 0x0 ref 1 00000100:00100000:1.0:1782487585.760920:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213178951255 time 7213178851255 state 0x1 ref 1 00000100:00100000:1.0:1782487585.760936:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294288896 00000100:00100000:1.0:1782487585.760938:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294288896 00000100:00100000:1.0:1782487585.760948:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213178951255 time 7213178851255 state 0x1 ref 2 00000100:00100000:1.0:1782487585.760963:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213182454051 time 7213182354051 state 0x1 ref 2 00000100:00100000:1.0:1782487585.760972:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+666:294399:x1869066294288768:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.761011:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.761036:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bd54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a18 expref: 666 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.761049:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb54b105400) 00000100:00100000:3.0:1782487585.761050:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213182454051 time 7213182438193 state 0x0 ref 2 00010000:00010000:1.0:1782487585.761060:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.761068:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+665:294398:x1869066294288896:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.761080:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.761093:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bd69 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a26 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.761116:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bd70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.761128:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bd70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.761138:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bd70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.761200:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.761242:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.761248:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006123cbc3 reply state 00000000b90b80a3 transno 8589956754 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85bd70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.761252:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.761268:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.761277:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.761290:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.761298:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.761323:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+668:294399:x1869066294288768:12345-192.168.202.21@tcp:36:touch.500 Request processed in 350us (719us total) trans 8589956754 rc 0/0 00000100:00100000:1.0:1782487585.761331:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26852 00000004:00080000:3.0:1782487585.761768:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1841:0x0], index 1: 0 00000100:00100000:1.0:1782487585.761771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.761835:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294289152 00000100:00100000:1.0:1782487585.761839:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294289152 00000100:00100000:1.0:1782487585.761863:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5738 00000100:00100000:1.0:1782487585.761870:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+668:294397:x1869066294289152:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.762022:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+669:294397:x1869066294289152:12345-192.168.202.21@tcp:35:touch.500 Request processed in 151us (252us total) trans 8589956755 rc 0/0 00000100:00100000:1.0:1782487585.762028:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5738 00010000:00010000:3.0:1782487585.764151:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bd85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764168:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bd85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764180:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bd85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764230:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764239:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764246:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764253:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.764258:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764266:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764283:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.764287:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.764291:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764298:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bd77 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.764311:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e922674 reply state 0000000013deb30c transno 8589956756 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.764320:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.764353:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bd69 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a26 expref: 670 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764370:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85bd85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a26 expref: 669 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.764378:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:3.0:1782487585.764381:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.764384:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4000, rc 0) 00000100:00100000:3.0:1782487585.764438:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+670:294398:x1869066294288896:12345-192.168.202.21@tcp:101:touch.500 Request processed in 3373us (3651us total) trans 8589956756 rc 0/0 00000100:00100000:3.0:1782487585.764448:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26853 00000100:00100000:3.0:1782487585.764455:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213182454051 time 7213182438193 state 0x2 ref 0 00000100:00100000:3.0:1782487585.764526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.764679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.764713:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294289280 00000100:00100000:3.0:1782487585.764719:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294289280 00000100:00100000:3.0:1782487585.764759:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16135 00000100:00100000:3.0:1782487585.764768:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2360:x1869066294289280:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.765039:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+104:2360:x1869066294289280:12345-192.168.202.21@tcp:2:touch.500 Request processed in 271us (512us total) trans 8589939991 rc 0/0 00000100:00100000:3.0:1782487585.765048:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16135 00000100:00100000:3.0:1782487585.765072:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294289408 00000100:00100000:3.0:1782487585.765076:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294289408 00000100:00100000:3.0:1782487585.765095:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213182454051 time 7213182438193 state 0x0 ref 1 00000100:00100000:3.0:1782487585.765105:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213182538193 time 7213182438193 state 0x1 ref 1 00000100:00100000:3.0:1782487585.765126:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213182538193 time 7213186516028 state 0x0 ref 1 00000100:00100000:3.0:1782487585.765137:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+670:294399:x1869066294289408:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.765151:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.765165:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bd93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a2d expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.765199:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bd93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a2d expref: 671 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.765916:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bd93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a2d expref: 670 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.765938:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487585.765942:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.765945:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683ca600, rc 0) 00000100:00100000:3.0:1782487585.765976:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+670:294399:x1869066294289408:12345-192.168.202.21@tcp:101:touch.500 Request processed in 841us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.765986:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26854 00000100:00100000:3.0:1782487585.765991:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213182538193 time 7213186516028 state 0x2 ref 0 00010000:00010000:1.0:1782487585.766781:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766791:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766798:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766803:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.766806:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766813:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766822:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4549e8000) 00010000:00010000:1.0:1782487585.766825:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.766828:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.766834:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85bd7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.767426:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294289664 00000100:00100000:3.0:1782487585.767432:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294289664 00000100:00100000:3.0:1782487585.767473:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5739 00000100:00100000:3.0:1782487585.767483:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5482f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+669:294393:x1869066294289664:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.768882:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5482f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+669:294393:x1869066294289664:12345-192.168.202.21@tcp:35:touch.500 Request processed in 1398us (1571us total) trans 8589956757 rc 0/0 00000100:00100000:3.0:1782487585.768892:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5739 00000100:00100000:3.0:1782487585.769008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.769079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.769186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.769229:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294290048 00000100:00100000:3.0:1782487585.769234:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294290048 00000100:00100000:3.0:1782487585.769271:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1139 00000100:00100000:3.0:1782487585.769280:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579c1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+669:2363:x1869066294290048:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.769303:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.769314:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bdaf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a34 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769348:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769361:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769369:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769382:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769390:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769397:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769473:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769482:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.769489:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.769507:0:190302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2f:0x0]: returning size 0 00000004:00200000:3.0:1782487585.769511:0:190302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1782487585.770336:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294290176 00000100:00100000:1.0:1782487585.770343:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294290176 00000100:00100000:1.0:1782487585.770380:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16136 00000100:00100000:1.0:1782487585.770388:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066294290176:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.770582:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+130:2360:x1869066294290176:12345-192.168.202.21@tcp:2:touch.500 Request processed in 194us (1504us total) trans 8589940654 rc 0/0 00000100:00100000:1.0:1782487585.770589:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16136 00000004:00010000:3.0:1782487585.770674:0:190302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770686:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770699:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770705:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770712:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770719:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.770722:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770729:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770740:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.770743:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.770747:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770753:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bdb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770764:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770771:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770778:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770785:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.770788:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770795:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770805:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4549e8600) 00010000:00010000:3.0:1782487585.770809:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.770812:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770819:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85bdbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770846:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bdaf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a34 expref: 673 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770860:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a34 expref: 672 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.770866:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c4bb4800) 00010000:00010000:3.0:1782487585.770868:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.770870:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d600, rc 0) 00000100:00100000:3.0:1782487585.770896:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579c1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+672:2363:x1869066294290048:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1619us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.770901:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1139 00010000:00010000:3.0:1782487585.771016:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.771021:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.771026:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.771029:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.771034:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.771042:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb29:0x0].0x0 (ffff9cb54b105800) 00010000:00010000:3.0:1782487585.771044:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.771046:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdcb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.771050:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.771066:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.771069:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.771073:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.772871:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772880:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772885:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772889:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.772892:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772897:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772907:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb54b105b00) 00010000:00010000:3.0:1782487585.772909:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.772911:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.772915:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bda1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.774684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.775057:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294290688 00000100:00100000:1.0:1782487585.775065:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294290688 00000100:00100000:1.0:1782487585.775106:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5740 00000100:00100000:1.0:1782487585.775115:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+670:294399:x1869066294290688:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.775408:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+671:294399:x1869066294290688:12345-192.168.202.21@tcp:35:touch.500 Request processed in 293us (728us total) trans 8589956760 rc 0/0 00000100:00100000:1.0:1782487585.775416:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5740 00000100:00100000:1.0:1782487585.776237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.776308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.778224:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778235:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778244:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778250:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.778255:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778262:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778276:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb54b105e00) 00010000:00010000:3.0:1782487585.778279:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.778283:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.778291:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bde7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.780703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.783034:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294291328 00000100:00100000:3.0:1782487585.783040:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294291328 00000100:00100000:3.0:1782487585.783059:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213198924674 time 7213202665454 state 0x0 ref 1 00000100:00100000:3.0:1782487585.783068:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213202765454 time 7213202665454 state 0x1 ref 1 00000100:00100000:3.0:1782487585.783090:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213202765454 time 7213204480698 state 0x0 ref 1 00000100:00100000:3.0:1782487585.783103:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+677:294409:x1869066294291328:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.783132:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.783188:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bdee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a3b expref: 677 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.783203:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb54b105c00) 00010000:00010000:3.0:1782487585.783221:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.783270:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.783278:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.783284:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.783353:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006d3889b reply state 0000000085efab88 transno 8589956763 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.783359:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.783394:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294409:x1869066294291328:12345-192.168.202.21@tcp:36:touch.500 Request processed in 295us (491us total) trans 8589956763 rc 0/0 00000100:00100000:3.0:1782487585.783399:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26860 00000100:00100000:3.0:1782487585.783402:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213202765454 time 7213204480698 state 0x2 ref 0 00000100:00100000:3.0:1782487585.783560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.783651:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294291712 00000100:00100000:1.0:1782487585.783657:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294291712 00000100:00100000:1.0:1782487585.783690:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16137 00000100:00100000:1.0:1782487585.783698:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+104:2361:x1869066294291712:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.783876:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2361:x1869066294291712:12345-192.168.202.21@tcp:2:touch.500 Request processed in 179us (315us total) trans 8589939992 rc 0/0 00000100:00100000:1.0:1782487585.783883:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16137 00000100:00100000:3.0:1782487585.787364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.787626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.787863:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294292224 00000100:00100000:1.0:1782487585.787872:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294292224 00000100:00100000:1.0:1782487585.787907:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213202765454 time 7213204480698 state 0x0 ref 1 00000100:00100000:1.0:1782487585.787920:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213204580698 time 7213204480698 state 0x1 ref 1 00000100:00100000:1.0:1782487585.787943:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294292096 00000100:00100000:1.0:1782487585.787947:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294292096 00000100:00100000:1.0:1782487585.787963:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213204580698 time 7213204480698 state 0x1 ref 2 00000100:00100000:1.0:1782487585.787984:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213209474898 time 7213209374898 state 0x1 ref 2 00000100:00100000:1.0:1782487585.787998:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294411:x1869066294292224:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.788054:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.788079:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85be18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a49 expref: 678 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.788097:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb54b105700) 00000100:00100000:3.0:1782487585.788419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.788492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.788564:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294292352 00000100:00100000:3.0:1782487585.788568:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294292352 00000100:00100000:3.0:1782487585.788584:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213209474898 time 7213209374898 state 0x1 ref 3 00000100:00100000:3.0:1782487585.788600:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213210091655 time 7213209991655 state 0x1 ref 3 00000100:00100000:3.0:1782487585.788621:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294410:x1869066294292096:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.788629:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.788641:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85be2d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a50 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788904:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788919:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788927:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788939:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788944:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.788949:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789265:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1782487585.789380:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1869:0x0], index 0: 0 00010000:00010000:1.0:1782487585.789403:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85be42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789415:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85be42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789425:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85be42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.789516:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006238f459 reply state 000000006fff080b transno 8589956765 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85be42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.789525:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.789824:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294411:x1869066294292224:12345-192.168.202.21@tcp:36:touch.500 Request processed in 1828us (2465us total) trans 8589956765 rc 0/0 00000100:00100000:1.0:1782487585.789834:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26861 00000100:00100000:1.0:1782487585.789864:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213210091655 time 7213211253605 state 0x0 ref 2 00000100:00100000:1.0:1782487585.789877:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294409:x1869066294292352:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.789892:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.789902:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85be49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a57 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789933:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85be49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a57 expref: 682 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789946:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85be49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a57 expref: 682 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.789963:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487585.789967:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.789970:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c800, rc 0) 00000100:00100000:1.0:1782487585.789992:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294409:x1869066294292352:12345-192.168.202.21@tcp:101:touch.500 Request processed in 118us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.789999:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26863 00010000:00010000:3.0:1782487585.790504:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85be50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.790696:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294292608 00000100:00100000:1.0:1782487585.790704:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294292608 00000100:00100000:1.0:1782487585.790743:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5741 00000100:00100000:1.0:1782487585.790753:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294398:x1869066294292608:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487585.790812:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85be50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790823:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85be50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790864:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790872:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790879:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790887:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.790893:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790901:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790914:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.790917:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.790922:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790929:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85be34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.790943:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a15a0130 reply state 00000000d1c2a328 transno 8589956764 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.790951:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.790963:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294398:x1869066294292608:12345-192.168.202.21@tcp:35:touch.500 Request processed in 210us (2468us total) trans 8589956766 rc 0/0 00000100:00100000:1.0:1782487585.790973:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5741 00010000:00010000:3.0:1782487585.790981:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85be2d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a50 expref: 684 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.790996:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85be50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a50 expref: 682 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.791004:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:3.0:1782487585.791007:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.791008:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.791011:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481a00, rc 0) 00010000:00010000:1.0:1782487585.791020:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791028:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791033:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.791037:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.791046:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294410:x1869066294292096:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2436us (3417us total) trans 8589956764 rc 0/0 00010000:00010000:1.0:1782487585.791047:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.791061:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26862 00010000:00010000:1.0:1782487585.791066:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb4549e8600) 00000100:00100000:3.0:1782487585.791068:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213210091655 time 7213211253605 state 0x2 ref 0 00010000:00010000:1.0:1782487585.791072:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.791078:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791086:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85be26 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.791330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.791354:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294292864 00000100:00100000:3.0:1782487585.791358:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294292864 00000100:00100000:3.0:1782487585.791379:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213210091655 time 7213211253605 state 0x0 ref 1 00000100:00100000:3.0:1782487585.791389:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213211353605 time 7213211253605 state 0x1 ref 1 00000100:00100000:1.0:1782487585.791429:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213211353605 time 7213212818610 state 0x0 ref 1 00000100:00100000:1.0:1782487585.791444:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1045:294424:x1869066294292864:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.791455:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.791466:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85be5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a5e expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791579:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791590:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791599:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791632:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791640:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791648:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791730:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85be73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791740:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85be73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791748:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85be73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.791758:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2a:0x0]: returning size 0 00010000:00010000:1.0:1782487585.791820:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791832:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791839:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791845:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.791850:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791857:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791869:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.791873:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.791877:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791883:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85be65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791895:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791902:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791909:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791915:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.791920:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791927:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791937:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb4664e1b00) 00010000:00010000:1.0:1782487585.791941:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.791945:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791952:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85be6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.791987:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85be5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a5e expref: 1048 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792003:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85be73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a5e expref: 1047 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792010:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.792013:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.792016:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498600, rc 0) 00000100:00100000:1.0:1782487585.792056:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294424:x1869066294292864:12345-192.168.202.21@tcp:101:touch.500 Request processed in 615us (726us total) trans 8589956767 rc 0/0 00000100:00100000:1.0:1782487585.792064:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26864 00000100:00100000:1.0:1782487585.792069:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213211353605 time 7213212818610 state 0x2 ref 0 00010000:00010000:1.0:1782487585.792852:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792862:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792867:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.792872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.792874:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.792879:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792883:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792893:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4549e8900) 00010000:00010000:1.0:1782487585.792897:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.792901:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.792907:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85be3b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.792964:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.793011:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294293376 00000100:00100000:1.0:1782487585.793016:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294293376 00000100:00100000:3.0:1782487585.793025:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.793032:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213211353605 time 7213212818610 state 0x0 ref 1 00000100:00100000:1.0:1782487585.793039:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213212918610 time 7213212818610 state 0x1 ref 1 00000100:00100000:1.0:1782487585.793057:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294293120 00000100:00100000:1.0:1782487585.793059:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294293120 00000100:00100000:3.0:1782487585.793065:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294293632 00000100:00100000:3.0:1782487585.793071:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294293632 00000100:00100000:1.0:1782487585.793071:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213212918610 time 7213212818610 state 0x1 ref 2 00000100:00100000:1.0:1782487585.793091:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213214583029 time 7213214483029 state 0x1 ref 2 00000100:00100000:3.0:1782487585.793100:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213214583029 time 7213214483029 state 0x1 ref 3 00000100:00100000:1.0:1782487585.793101:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294410:x1869066294293376:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.793131:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.793143:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85be50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a50 expref: 683 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.793154:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4549e8d00) 00000100:00100000:3.0:1782487585.793161:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213214651833 time 7213214551833 state 0x1 ref 3 00010000:00010000:1.0:1782487585.793162:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.793174:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294411:x1869066294293120:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.793182:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.793192:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85be81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a65 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.793220:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85be88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.793234:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85be88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793235:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85be81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a65 expref: 683 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.793253:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85be88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793258:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85be81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a65 expref: 683 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793276:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.793278:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.793280:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4000, rc 0) 00000100:00100000:3.0:1782487585.793307:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294411:x1869066294293120:12345-192.168.202.21@tcp:101:touch.500 Request processed in 135us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.793314:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26866 00000100:00100000:3.0:1782487585.793331:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213214651833 time 7213214721714 state 0x0 ref 2 00000100:00100000:3.0:1782487585.793340:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294386:x1869066294293632:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.793361:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487585.793377:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bbe8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779a8 expref: 683 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793399:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85b956 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778c8 expref: 682 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.793407:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b49b20ba reply state 00000000fbc8d3d8 transno 8589956768 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85be88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.793417:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.793418:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85b845 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47787b expref: 681 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793428:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487585.793435:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.793445:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793452:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793458:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.793467:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294410:x1869066294293376:12345-192.168.202.21@tcp:36:touch.500 Request processed in 366us (597us total) trans 8589956768 rc 0/0 00010000:00010000:3.0:1782487585.793468:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793481:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.793483:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26865 00010000:00010000:3.0:1782487585.793491:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793569:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793575:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.793580:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.794102:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2520, 64 off169472 00010000:00010000:3.0:1782487585.794163:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794170:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794177:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794183:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794188:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794194:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794222:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.794236:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794241:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.794244:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794247:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794256:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794269:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.794270:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.794278:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794278:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794285:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794292:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794295:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:3.0:1782487585.794300:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.794305:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794311:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85be9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794329:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794335:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794341:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794346:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.794349:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794355:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794357:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb26:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:1.0:1782487585.794364:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.794370:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794371:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.794378:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.794384:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bea4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794385:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.794399:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85be8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.794411:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d432afd reply state 00000000a5c91a00 transno 8589956769 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.794412:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.794416:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.794420:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.794422:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.794452:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294386:x1869066294293632:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1112us (1428us total) trans 8589956769 rc 0/0 00000100:00100000:3.0:1782487585.794461:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26867 00000100:00100000:3.0:1782487585.794464:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213214651833 time 7213214721714 state 0x2 ref 0 00000100:00100000:3.0:1782487585.796546:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.796604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.796686:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294293888 00000100:00100000:1.0:1782487585.796692:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294293888 00000100:00100000:1.0:1782487585.796716:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213214651833 time 7213214721714 state 0x0 ref 1 00000100:00100000:1.0:1782487585.796728:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213214821714 time 7213214721714 state 0x1 ref 1 00000100:00100000:1.0:1782487585.796754:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213214821714 time 7213218143855 state 0x0 ref 1 00000100:00100000:1.0:1782487585.796767:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1047:294424:x1869066294293888:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.796803:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.796826:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85be73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a5e expref: 1047 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.796843:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.796847:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.796899:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.796913:0:190296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 680 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.796922:0:190296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.796954:0:190296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 680 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.796978:0:190296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 680 pid: 213218 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.796995:0:190296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44b4d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:190296:1869066299219072:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487585.797071:0:190296:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4542f1300 going to sleep for 11 seconds 00010000:00010000:1.0:1782487585.798920:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798931:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798938:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798947:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.798950:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798957:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798967:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4549e8000) 00010000:00010000:1.0:1782487585.798970:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.798973:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.798979:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85be96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.801228:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294294016 00000100:00100000:3.0:1782487585.801237:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294294016 00000100:00100000:3.0:1782487585.801274:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213218243855 time 7213218143855 state 0x1 ref 2 00000100:00100000:1.0:1782487585.801288:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294294144 00000100:00100000:1.0:1782487585.801294:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294294144 00000100:00100000:1.0:1782487585.801339:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16139 00000100:00100000:1.0:1782487585.801352:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2361:x1869066294294144:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.801353:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294294400 00000100:00100000:3.0:1782487585.801360:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294294400 00000100:00100000:3.0:1782487585.801381:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213218243855 time 7213218143855 state 0x1 ref 3 00000100:00100000:3.0:1782487585.801407:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213222896515 time 7213222796515 state 0x1 ref 3 00000100:00100000:3.0:1782487585.801421:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+680:294410:x1869066294294016:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.801439:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.801462:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85beb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a6c expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.801511:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85beb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a6c expref: 681 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.801536:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85beb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a6c expref: 680 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.801558:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5d1ac00) 00010000:00010000:3.0:1782487585.801562:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.801568:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8dc00, rc 0) 00000100:00100000:1.0:1782487585.801677:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2361:x1869066294294144:12345-192.168.202.21@tcp:2:touch.500 Request processed in 327us (418us total) trans 8589939993 rc 0/0 00000100:00100000:1.0:1782487585.801692:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16139 00000100:00100000:1.0:1782487585.801731:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294294656 00000100:00100000:1.0:1782487585.801736:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294294656 00000100:00100000:1.0:1782487585.801766:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5742 00000100:00100000:1.0:1782487585.801775:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294409:x1869066294294656:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.801785:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294410:x1869066294294016:12345-192.168.202.21@tcp:101:touch.500 Request processed in 365us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.801794:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26869 00000100:00100000:1.0:1782487585.801963:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294409:x1869066294294656:12345-192.168.202.21@tcp:35:touch.500 Request processed in 190us (636us total) trans 8589956770 rc 0/0 00000100:00100000:1.0:1782487585.801970:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5742 00000100:00100000:1.0:1782487585.801991:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294294784 00000100:00100000:1.0:1782487585.801994:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294294784 00010000:00010000:1.0:1782487585.802012:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 679 pid: 213218 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.802038:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6146 00000100:00100000:1.0:1782487585.802045:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:2360:x1869066294294784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487585.802052:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.802056:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 679 pid: 213218 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.802065:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bbcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a47799a expref: 679 pid: 213218 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.802077:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.802080:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.802086:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.802091:0:190284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.802104:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487585.802121:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:2360:x1869066294294784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 78us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.802129:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6146 00010000:00010000:3.0:1782487585.802656:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.802666:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bece lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.802680:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.802687:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bece lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.802700:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bece lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.802714:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb27:0x0].0x0 (ffff9cb54b105700) 00010000:00010000:3.0:1782487585.802719:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.802724:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bece lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.802731:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bece lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.802753:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.802757:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.802761:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.808832:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.808846:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.808858:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294295040 00010000:00010000:3.0:1782487585.808860:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.808868:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294295040 00010000:00010000:3.0:1782487585.808869:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.808876:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.808885:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.808902:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb54b105a00) 00010000:00010000:3.0:1782487585.808906:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.808911:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.808917:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bec0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.808926:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5743 00000100:00100000:1.0:1782487585.808941:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294411:x1869066294295040:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.809343:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294411:x1869066294295040:12345-192.168.202.21@tcp:35:touch.500 Request processed in 405us (527us total) trans 8589956773 rc 0/0 00000100:00100000:1.0:1782487585.809353:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5743 00000100:00100000:1.0:1782487585.812286:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294295168 00000100:00100000:1.0:1782487585.812294:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294295168 00000100:00100000:1.0:1782487585.812346:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16140 00000100:00100000:1.0:1782487585.812357:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2360:x1869066294295168:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.812583:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294295424 00000100:00100000:3.0:1782487585.812588:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294295424 00000100:00100000:3.0:1782487585.812631:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213222896515 time 7213222822562 state 0x0 ref 1 00000100:00100000:3.0:1782487585.812643:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213222922562 time 7213222822562 state 0x1 ref 1 00000100:00100000:3.0:1782487585.812667:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213222922562 time 7213234057351 state 0x0 ref 1 00000100:00100000:3.0:1782487585.812679:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294390:x1869066294295424:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:1.0:1782487585.812717:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2360:x1869066294295168:12345-192.168.202.21@tcp:2:touch.500 Request processed in 361us (494us total) trans 8589940656 rc 0/0 00010000:00010000:3.0:1782487585.812721:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:1.0:1782487585.812725:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16140 00010000:00010000:3.0:1782487585.812745:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85bc20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779b6 expref: 679 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812768:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85b98e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778d6 expref: 678 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812786:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85b87d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477890 expref: 677 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812798:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4664e1500) 00010000:00010000:3.0:1782487585.812808:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.812827:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812840:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812849:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812864:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812870:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812877:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812982:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812990:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.812999:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.813547:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2521, 64 off169536 00010000:00010000:3.0:1782487585.813641:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813754:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813765:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813774:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813781:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813788:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813806:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.813824:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813831:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813838:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813848:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.813852:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813860:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813871:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.813875:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.813940:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813949:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85bee3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813967:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813974:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813980:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813986:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.813990:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.813997:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814012:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.814015:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.814019:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814026:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85bed5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.814037:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008502b99d reply state 000000000238f3cb transno 8589956774 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.814046:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.814097:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294390:x1869066294295424:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1420us (1818us total) trans 8589956774 rc 0/0 00000100:00100000:3.0:1782487585.814106:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26871 00000100:00100000:3.0:1782487585.814112:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213222922562 time 7213234057351 state 0x2 ref 0 00000100:00100000:3.0:1782487585.814136:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294295680 00000100:00100000:3.0:1782487585.814140:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294295680 00000100:00100000:3.0:1782487585.814155:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213222922562 time 7213234057351 state 0x0 ref 1 00000100:00100000:3.0:1782487585.814163:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213234157351 time 7213234057351 state 0x1 ref 1 00000100:00100000:3.0:1782487585.814240:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294295808 00000100:00100000:3.0:1782487585.814244:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294295808 00000100:00100000:3.0:1782487585.814260:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213234157351 time 7213234057351 state 0x1 ref 2 00000100:00100000:3.0:1782487585.814286:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213235776751 time 7213235676751 state 0x1 ref 2 00000100:00100000:3.0:1782487585.814296:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1049:294430:x1869066294295680:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.814310:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.814322:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85bef1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a73 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.814338:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bef8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a7a expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.814374:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bef8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a7a expref: 1051 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.814386:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70200/0x66475b4e8b85bef8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a7a expref: 1051 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.814403:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.814406:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.814409:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.814409:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70200, rc 0) 00010000:00010000:3.0:1782487585.814418:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814426:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814440:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814535:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.814543:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.814596:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4b4feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1051:294424:x1869066294295808:12345-192.168.202.21@tcp:101:touch.500 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.814622:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26873 00000100:00100000:2.0:1782487585.814730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:3.0:1782487585.815008:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1843:0x0], index 1: 0 00010000:00010000:1.0:1782487585.815056:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815063:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815069:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815073:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.815076:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815081:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815090:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:1.0:1782487585.815093:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.815095:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.815099:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85beab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.815123:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294296064 00000100:00100000:1.0:1782487585.815127:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294296064 00010000:00010000:3.0:1782487585.815147:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf0d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.815157:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5744 00010000:00010000:3.0:1782487585.815159:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.815166:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294410:x1869066294296064:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487585.815171:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815222:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815229:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815234:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815239:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.815241:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815246:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815253:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.815255:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.815258:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815261:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85beff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.815270:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a34d4e4 reply state 000000000738cbeb transno 8589956775 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.815274:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.815294:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85bef1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a73 expref: 1051 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815309:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a73 expref: 1050 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815316:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:3.0:1782487585.815319:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.815322:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6200, rc 0) 00000100:00100000:3.0:1782487585.815362:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1051:294430:x1869066294295680:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1066us (1501us total) trans 8589956775 rc 0/0 00000100:00100000:1.0:1782487585.815366:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294410:x1869066294296064:12345-192.168.202.21@tcp:35:touch.500 Request processed in 200us (635us total) trans 8589956776 rc 0/0 00000100:00100000:3.0:1782487585.815379:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26872 00000100:00100000:1.0:1782487585.815379:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5744 00000100:00100000:3.0:1782487585.815390:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213235776751 time 7213235698731 state 0x2 ref 0 00010000:00010000:3.0:1782487585.815424:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.815431:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815437:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.815442:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815449:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815460:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb28:0x0].0x0 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.815464:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.815467:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815474:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85beea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815492:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.815495:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.815497:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.815560:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815568:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815575:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815581:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.815584:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815592:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815602:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c5d1a800) 00010000:00010000:3.0:1782487585.815628:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.815632:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.815639:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bedc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.816909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.816974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.817428:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817435:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817440:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817445:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.817449:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817457:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817471:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4c4bb4700) 00010000:00010000:1.0:1782487585.817474:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.817478:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.817485:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.817674:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294296448 00000100:00100000:2.0:1782487585.817680:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294296448 00000100:00100000:2.0:1782487585.817724:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16141 00000100:00100000:2.0:1782487585.817735:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2363:x1869066294296448:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:2.0:1782487585.817896:0:213384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x183b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782487585.817899:0:213384:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x183b:0x0] updating lvb mtime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487585.817901:0:213384:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x183b:0x0] updating lvb atime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487585.817903:0:213384:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x183b:0x0] updating lvb ctime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487585.817905:0:213384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x183b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782487585.817937:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2363:x1869066294296448:12345-192.168.202.21@tcp:2:touch.500 Request processed in 206us (966us total) trans 8589939994 rc 0/0 00000100:00100000:2.0:1782487585.817943:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16141 00000100:00100000:2.0:1782487585.818088:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294296320 00000100:00100000:2.0:1782487585.818091:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294296320 00000100:00100000:2.0:1782487585.818106:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213235776751 time 7213235698731 state 0x0 ref 1 00000100:00100000:2.0:1782487585.818114:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213235798731 time 7213235698731 state 0x1 ref 1 00000100:00100000:2.0:1782487585.818130:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213235798731 time 7213239520785 state 0x0 ref 1 00000100:00100000:2.0:1782487585.818137:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294403:x1869066294296320:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.818169:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782487585.818184:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85bc3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779bd expref: 678 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818199:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85b9aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778dd expref: 677 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818226:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85b910 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778ba expref: 676 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818239:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb558966700) 00010000:00010000:2.0:1782487585.818249:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.818266:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818278:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818288:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818305:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818313:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818319:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818426:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818434:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.818441:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.818989:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2529, 64 off170048 00010000:00010000:2.0:1782487585.819074:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819084:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819093:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819102:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819109:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819115:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819132:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.819150:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819152:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.819157:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819159:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819163:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819166:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.819168:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.819170:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819172:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819177:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819179:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819192:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb54b105e00) 00010000:00010000:3.0:1782487585.819195:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.819199:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819201:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2b:0x0].0x0 (ffff9cb54b105e00) 00010000:00010000:2.0:1782487585.819213:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.819214:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819216:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819222:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf29 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819227:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.819230:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.819233:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.819241:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819253:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819260:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819266:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.819269:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819276:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819283:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.819285:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.819288:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.819293:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.819305:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f229c20f reply state 00000000a5aad3a8 transno 8589956777 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.819313:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.819365:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+677:294403:x1869066294296320:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1227us (2506us total) trans 8589956777 rc 0/0 00000100:00100000:2.0:1782487585.819375:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26874 00000100:00100000:2.0:1782487585.819381:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213235798731 time 7213239520785 state 0x2 ref 0 00000100:00100000:3.0:1782487585.819532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.819560:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294296704 00000100:00100000:2.0:1782487585.819565:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294296704 00000100:00100000:2.0:1782487585.819600:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5745 00000100:00100000:2.0:1782487585.819628:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5482fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1050:294424:x1869066294296704:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.819629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.819658:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294296960 00000100:00100000:3.0:1782487585.819661:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294296960 00000100:00100000:3.0:1782487585.819679:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213235798731 time 7213239520785 state 0x0 ref 1 00000100:00100000:3.0:1782487585.819697:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213239620785 time 7213239520785 state 0x1 ref 1 00000100:00100000:3.0:1782487585.819718:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213239620785 time 7213241108757 state 0x0 ref 1 00000100:00100000:3.0:1782487585.819728:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45ac59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294430:x1869066294296960:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.819752:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487585.819754:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5482fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294424:x1869066294296704:12345-192.168.202.21@tcp:35:touch.500 Request processed in 146us (223us total) trans 8589956778 rc 0/0 00000100:00100000:2.0:1782487585.819761:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5745 00010000:00010000:3.0:1782487585.819767:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf0d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a73 expref: 1052 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.819779:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb4c4bb4000) 00010000:00010000:3.0:1782487585.819785:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.820006:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820017:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820026:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.820103:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001ab1ef2 reply state 0000000071f50eb9 transno 8589956779 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.820111:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.820161:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45ac59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294430:x1869066294296960:12345-192.168.202.21@tcp:36:touch.500 Request processed in 433us (531us total) trans 8589956779 rc 0/0 00000100:00100000:3.0:1782487585.820168:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26875 00000100:00100000:3.0:1782487585.820173:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213239620785 time 7213241108757 state 0x2 ref 0 00010000:00010000:3.0:1782487585.820294:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820303:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820315:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820321:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.820325:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820447:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820460:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb54b105c00) 00010000:00010000:3.0:1782487585.820468:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.820472:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.820479:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.820881:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.820916:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297216 00000100:00100000:3.0:1782487585.820922:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297216 00000100:00100000:3.0:1782487585.820943:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213239620785 time 7213241108757 state 0x0 ref 1 00000100:00100000:3.0:1782487585.820952:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213241208757 time 7213241108757 state 0x1 ref 1 00000100:00100000:3.0:1782487585.820977:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213241208757 time 7213242367293 state 0x0 ref 1 00000100:00100000:3.0:1782487585.820989:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+676:294407:x1869066294297216:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.821018:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487585.821035:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85bc58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779c4 expref: 676 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821057:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85b9cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778e4 expref: 675 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821072:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85b91e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778c1 expref: 674 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821081:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb558966b00) 00010000:00010000:3.0:1782487585.821091:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.821104:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821113:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821120:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821131:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821138:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821144:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821245:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821254:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821263:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821415:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821425:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821433:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821440:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.821444:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821451:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821464:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb567654200) 00010000:00010000:1.0:1782487585.821467:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.821471:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.821478:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bf37 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.821869:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2522, 64 off169600 00010000:00010000:3.0:1782487585.821946:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821956:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821965:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821973:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821981:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.821987:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822108:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.822124:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822131:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822137:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822147:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.822151:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822158:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822169:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb567654f00) 00010000:00010000:3.0:1782487585.822172:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.822175:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822181:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85bf4c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822197:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822203:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822439:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822446:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.822451:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822458:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822471:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.822474:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.822478:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822484:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bf3e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.822497:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0816ee7 reply state 0000000024f9f7a5 transno 8589956780 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.822501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.822505:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.822534:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297344 00000100:00100000:2.0:1782487585.822540:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297344 00000100:00100000:3.0:1782487585.822558:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+675:294407:x1869066294297216:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1571us (1677us total) trans 8589956780 rc 0/0 00000100:00100000:2.0:1782487585.822563:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213242467293 time 7213242367293 state 0x1 ref 2 00000100:00100000:3.0:1782487585.822573:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26876 00000100:00100000:2.0:1782487585.822584:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213242467293 time 7213243975020 state 0x0 ref 1 00000100:00100000:2.0:1782487585.822594:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1051:294430:x1869066294297344:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.822603:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.822626:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822634:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.822637:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822644:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.822651:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.822655:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2c:0x0].0x0 (ffff9cb567654f00) 00010000:00010000:3.0:1782487585.822657:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.822661:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822672:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bf53 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.822677:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bf5a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a81 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.822688:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.822691:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.822694:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.822713:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bf5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a81 expref: 1052 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.822726:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bf5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a81 expref: 1052 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.822743:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:2.0:1782487585.822747:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.822749:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70000, rc 0) 00000100:00100000:2.0:1782487585.822780:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294430:x1869066294297344:12345-192.168.202.21@tcp:101:touch.500 Request processed in 187us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.822787:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26877 00000100:00100000:2.0:1782487585.822792:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213242467293 time 7213243975020 state 0x2 ref 0 00010000:00010000:1.0:1782487585.823708:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823718:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823724:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823731:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.823735:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823741:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823752:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb567654500) 00010000:00010000:1.0:1782487585.823755:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.823759:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.823765:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54800/0x66475b4e8b85bf45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.824148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.824289:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297472 00000100:00100000:3.0:1782487585.824294:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297472 00000100:00100000:3.0:1782487585.824338:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16142 00000100:00100000:3.0:1782487585.824348:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2361:x1869066294297472:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.824579:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2361:x1869066294297472:12345-192.168.202.21@tcp:2:touch.500 Request processed in 233us (433us total) trans 8589939995 rc 0/0 00000100:00100000:3.0:1782487585.824585:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16142 00000100:00100000:2.0:1782487585.828678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.828730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.828768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828781:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297856 00000100:00100000:3.0:1782487585.828789:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297856 00000100:00100000:2.0:1782487585.828799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.828832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828834:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213242467293 time 7213243975020 state 0x0 ref 1 00000100:00100000:3.0:1782487585.828849:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 1 00000100:00100000:2.0:1782487585.828865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828879:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297984 00000100:00100000:3.0:1782487585.828884:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297984 00000100:00100000:3.0:1782487585.828903:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 2 00000100:00100000:2.0:1782487585.828914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828922:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298112 00000100:00100000:3.0:1782487585.828927:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298112 00000100:00100000:3.0:1782487585.828955:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 3 00000100:00100000:2.0:1782487585.828955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828971:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298240 00000100:00100000:3.0:1782487585.828975:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298240 00000100:00100000:2.0:1782487585.828985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.828991:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 4 00000100:00100000:3.0:1782487585.829003:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298368 00000100:00100000:3.0:1782487585.829007:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298368 00000100:00100000:3.0:1782487585.829022:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 5 00000100:00100000:3.0:1782487585.829033:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298496 00000100:00100000:3.0:1782487585.829038:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298496 00000100:00100000:2.0:1782487585.829040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.829054:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 6 00000100:00100000:3.0:1782487585.829067:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298624 00000100:00100000:3.0:1782487585.829070:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298624 00000100:00100000:2.0:1782487585.829080:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299392 00000100:00100000:1.0:1782487585.829080:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294297728 00000100:00100000:3.0:1782487585.829084:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 7 00000100:00100000:2.0:1782487585.829088:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299392 00000100:00100000:1.0:1782487585.829088:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294297728 00000100:00100000:3.0:1782487585.829101:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298880 00000100:00100000:3.0:1782487585.829105:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298880 00000100:00100000:3.0:1782487585.829125:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213244075020 time 7213243975020 state 0x1 ref 8 00000100:00100000:2.0:1782487585.829139:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294298752 00000100:00100000:2.0:1782487585.829144:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294298752 00000100:00100000:1.0:1782487585.829144:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5746 00000100:00100000:3.0:1782487585.829146:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213250636058 time 7213250536058 state 0x1 ref 8 00000100:00100000:1.0:1782487585.829160:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1052:294430:x1869066294297728:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.829166:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294427:x1869066294297856:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.829184:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.829191:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1140 00010000:00010000:3.0:1782487585.829217:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bf61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a88 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.829217:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45ac5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:2361:x1869066294299392:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487585.829257:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.829269:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477adc expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829276:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829292:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829301:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829309:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829314:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829327:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829345:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829353:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829362:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829388:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829402:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829412:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.829471:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1053:294430:x1869066294297728:12345-192.168.202.21@tcp:35:touch.500 Request processed in 313us (799us total) trans 8589956781 rc 0/0 00000100:00100000:1.0:1782487585.829481:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5746 00010000:00010000:2.0:1782487585.829492:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829499:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829503:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829515:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829518:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.829519:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213251008077 time 7213250908077 state 0x1 ref 8 00010000:00010000:3.0:1782487585.829537:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.829539:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+685:294417:x1869066294297984:12345-192.168.202.21@tcp:101:rm.500 00000004:00200000:2.0:1782487585.829549:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb34:0x0]: returning size 0 00010000:00010000:1.0:1782487585.829552:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1782487585.829554:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.829564:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85bf99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a96 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.829572:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.829577:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb37:0x0]: returning size 0 00000004:00200000:3.0:1782487585.829582:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.829584:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.829596:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.829597:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829599:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829634:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829641:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829649:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.829653:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829667:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829668:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829692:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829706:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829713:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829715:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.829722:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.829727:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.829729:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829733:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829742:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85bf76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829745:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829764:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.829765:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829769:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.829775:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829777:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829791:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85bf6f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829792:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829811:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.829813:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.829816:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829817:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829829:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829839:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.829839:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829841:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829860:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.829861:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb54b105e00) 00010000:00010000:2.0:1782487585.829866:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.829867:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.829868:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829870:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829886:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829889:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85bf84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.829889:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829905:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb567654e00) 00010000:00010000:3.0:1782487585.829910:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.829911:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829916:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829933:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85bf68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477adc expref: 687 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829934:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85bf7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829959:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477adc expref: 686 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829966:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487585.829968:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.829972:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71c00, rc 0) 00010000:00010000:2.0:1782487585.829977:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.829979:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85bf61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a88 expref: 687 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.829988:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bfae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ae3 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.829999:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a88 expref: 686 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830005:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830016:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:3.0:1782487585.830020:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.830021:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830024:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7c00, rc 0) 00010000:00010000:2.0:1782487585.830024:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830035:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830038:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830052:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.830055:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294427:x1869066294297856:12345-192.168.202.21@tcp:101:rm.500 Request processed in 895us (1324us total) trans 0 rc 0/0 00000004:00200000:1.0:1782487585.830057:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb31:0x0]: returning size 0 00000004:00200000:1.0:1782487585.830063:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.830067:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.830070:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26878 00000004:00010000:1.0:1782487585.830075:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830078:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830090:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830092:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.830096:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213251585035 time 7213251485035 state 0x1 ref 7 00010000:00010000:1.0:1782487585.830109:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830117:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.830118:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45aec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+686:294422:x1869066294298112:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.830131:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830137:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.830139:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.830144:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830150:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85bfca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a8f expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830152:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830171:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.830172:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830178:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.830182:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830185:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830191:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830194:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88000/0x66475b4e8b85bfa0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830214:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830224:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830228:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830234:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.830235:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb35:0x0]: returning size 0 00010000:00010000:3.0:1782487585.830242:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.830242:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.830249:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830257:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00000004:00010000:2.0:1782487585.830258:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830262:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830263:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830283:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830285:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830287:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830298:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb49c365f00) 00010000:00010000:1.0:1782487585.830305:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.830307:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830308:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830309:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830331:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830332:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85bfa7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830350:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830356:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.830360:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830367:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85bf99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a96 expref: 688 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830370:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830388:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a96 expref: 687 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830389:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.830395:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.830400:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830402:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb54b105d00) 00010000:00010000:1.0:1782487585.830408:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.830412:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85bfbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830412:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd89400, rc 0) 00010000:00010000:2.0:1782487585.830428:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830435:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.830437:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294417:x1869066294297984:12345-192.168.202.21@tcp:101:rm.500 Request processed in 900us (1669us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.830450:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.830451:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26879 00010000:00010000:2.0:1782487585.830460:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54151a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.830465:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830471:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.830475:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213251964046 time 7213251864046 state 0x1 ref 6 00010000:00010000:3.0:1782487585.830486:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830487:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb54b105800) 00000100:00100000:1.0:1782487585.830492:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+686:294425:x1869066294298240:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.830494:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.830500:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830504:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.830506:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830510:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85bfc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830515:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85bfed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477a9d expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830520:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.830547:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb34:0x0]: returning size 0 00010000:00010000:2.0:1782487585.830552:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85bfae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ae3 expref: 688 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830555:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830575:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830581:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ae3 expref: 687 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830585:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830595:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:2.0:1782487585.830601:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.830631:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830639:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830646:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830657:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498600, rc 0) 00010000:00010000:2.0:1782487585.830665:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.830676:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c002 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477aea expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830706:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830708:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830725:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830726:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830747:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830747:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.830757:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.830774:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.830779:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb36:0x0]: returning size 0 00000004:00010000:3.0:1782487585.830780:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830782:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.830784:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.830799:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830803:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830804:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830811:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830824:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830834:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830841:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830842:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830858:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830868:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830869:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.830876:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830877:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.830882:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830884:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830890:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830903:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830905:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830910:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.830918:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.830923:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.830924:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830928:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.830935:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.830943:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85bfd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830943:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.830951:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb36:0x0]: returning size 0 00000004:00200000:2.0:1782487585.830958:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.830960:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8da00/0x66475b4e8b85bff4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830967:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.830970:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830974:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.830993:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.830998:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831008:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831010:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831013:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831029:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.831030:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831031:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb54200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.831035:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831038:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831046:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831058:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831066:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831069:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831076:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb567654f00) 00010000:00010000:3.0:1782487585.831084:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.831085:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.831089:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831091:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4549e8000) 00010000:00010000:2.0:1782487585.831092:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831099:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.831104:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831108:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54200/0x66475b4e8b85bfdf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831112:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831119:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85bffb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831138:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.831142:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.831146:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831153:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c009 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831160:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85bfca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a8f expref: 690 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831162:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85bfed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a9d expref: 690 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831168:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831186:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831192:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a8f expref: 688 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831196:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a9d expref: 688 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831197:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831220:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487585.831227:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.831228:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.831231:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.831233:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831234:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55800, rc 0) 00010000:00010000:1.0:1782487585.831236:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.831241:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481a00, rc 0) 00010000:00010000:2.0:1782487585.831245:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831258:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4549e8000) 00010000:00010000:2.0:1782487585.831261:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782487585.831266:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45aec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294422:x1869066294298112:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1149us (2465us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.831267:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.831275:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294425:x1869066294298240:12345-192.168.202.21@tcp:101:rm.500 Request processed in 783us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.831283:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26880 00010000:00010000:2.0:1782487585.831283:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c017 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.831293:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26881 00000100:00100000:3.0:1782487585.831313:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213252801416 time 7213252701416 state 0x1 ref 4 00010000:00010000:2.0:1782487585.831320:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c002 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aea expref: 687 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.831325:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213252813822 time 7213252713822 state 0x1 ref 4 00000100:00100000:3.0:1782487585.831331:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294433:x1869066294298368:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.831347:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aea expref: 686 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.831347:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+686:294419:x1869066294298496:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.831360:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.831362:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.831366:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.831369:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07a00, rc 0) 00010000:00010000:1.0:1782487585.831372:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c025 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477aab expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831375:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.831387:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c02c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477af1 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831406:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.831407:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831417:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831420:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85c03a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477aa4 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831427:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831429:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831448:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831455:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831459:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831460:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831468:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831482:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831486:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831490:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831499:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831511:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831522:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831523:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831540:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831550:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831573:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831583:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831592:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.831632:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb32:0x0]: returning size 0 00010000:00010000:2.0:1782487585.831634:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.831636:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.831647:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.831650:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831659:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831662:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831675:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.831680:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2e:0x0]: returning size 0 00010000:00010000:1.0:1782487585.831681:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.831686:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.831695:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831703:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00000004:00010000:2.0:1782487585.831704:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831708:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831727:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831730:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831743:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831746:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831762:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831763:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831779:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831779:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.831782:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831786:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.831793:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831798:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.831805:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831807:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c033 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.831812:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb39:0x0]: returning size 0 00000004:00200000:3.0:1782487585.831819:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.831823:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831834:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.831835:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831835:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.831843:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.831849:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831852:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831857:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831860:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c041 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831868:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831878:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831880:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.831885:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831886:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831891:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831909:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831909:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831909:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831932:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.831933:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831933:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4549e8d00) 00010000:00010000:3.0:1782487585.831937:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831939:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.831944:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831951:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.831958:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831961:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.831961:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c048 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831978:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.831981:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.831983:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.831990:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.831997:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb54b105400) 00010000:00010000:3.0:1782487585.831999:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c04f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832003:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.832003:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c025 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aab expref: 690 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832010:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832021:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832025:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c056 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832031:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aab expref: 689 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832034:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832052:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb4c5d1a000) 00010000:00010000:3.0:1782487585.832053:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832057:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.832061:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb455050600, rc 0) 00010000:00010000:3.0:1782487585.832064:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.832070:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c02c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af1 expref: 690 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832071:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832089:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.832090:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294419:x1869066294298496:12345-192.168.202.21@tcp:101:rm.500 Request processed in 745us (3187us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.832098:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af1 expref: 689 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832112:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb567654400) 00010000:00010000:2.0:1782487585.832115:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4ba768900) 00000100:00100000:1.0:1782487585.832117:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26883 00010000:00010000:3.0:1782487585.832118:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.832121:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.832125:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832126:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e600, rc 0) 00010000:00010000:2.0:1782487585.832134:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.832137:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c05d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832146:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c079 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477af8 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.832146:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253633455 time 7213253533455 state 0x1 ref 3 00000100:00100000:1.0:1782487585.832165:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294423:x1869066294298624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.832172:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55c00/0x66475b4e8b85c03a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aa4 expref: 690 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832175:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.832181:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832188:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85c087 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ab2 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.832193:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.832236:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832289:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aa4 expref: 689 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832301:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5d1ac00) 00010000:00010000:3.0:1782487585.832305:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.832308:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00000100:00100000:3.0:1782487585.832394:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb442722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294433:x1869066294298368:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1008us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.832404:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26882 00000100:00100000:3.0:1782487585.832426:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253633455 time 7213253816660 state 0x0 ref 2 00000100:00100000:3.0:1782487585.832440:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:294416:x1869066294298880:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.832449:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.832459:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c095 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ac0 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.832487:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833159:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833176:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833194:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833220:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833222:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.833225:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1141 00010000:00010000:1.0:1782487585.833241:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833243:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.833243:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:2360:x1869066294298752:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487585.833259:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833270:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833272:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.833285:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c0b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ab9 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833287:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833305:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833326:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833335:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833337:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833354:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833356:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833373:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833379:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833388:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.833394:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb35:0x0]: returning size 0 00000004:00200000:1.0:1782487585.833400:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.833404:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.833416:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833427:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833437:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833445:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833452:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833455:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833458:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833472:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833477:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833481:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.833482:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833489:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833490:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833492:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.833500:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833510:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833513:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.833521:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2f:0x0]: returning size 0 00010000:00010000:1.0:1782487585.833527:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000004:00200000:3.0:1782487585.833528:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.833534:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.833538:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.833542:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833543:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.833550:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.833556:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833563:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c08e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833565:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833567:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c0b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833586:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833593:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833595:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833627:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833633:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.833637:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833644:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833652:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4549e8900) 00010000:00010000:1.0:1782487585.833654:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.833657:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833663:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c0a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833681:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833689:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fc71800/0x66475b4e8b85c087 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ab2 expref: 692 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833692:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833701:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833709:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.833715:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833721:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833733:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833734:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ab2 expref: 691 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833736:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833753:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8ef95a8 (ffff9cb54b105000) 00010000:00010000:1.0:1782487585.833758:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:2.0:1782487585.833759:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.833763:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833766:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.833767:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.833772:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c0c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.833773:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4af600, rc 0) 00010000:00010000:3.0:1782487585.833774:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833790:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833801:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c0b1 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ab9 expref: 691 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833805:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.833809:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.833813:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833819:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c09c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833822:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.833825:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.833830:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c0b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ab9 expref: 691 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833844:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5735d7000, rc -2) 00010000:00010000:3.0:1782487585.833846:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833855:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833862:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.833868:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:2360:x1869066294298752:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 632us (4885us total) trans 0 rc -2/-2 00010000:00010000:3.0:1782487585.833872:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.833878:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.833882:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1141 00010000:00010000:3.0:1782487585.833890:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833904:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb567654300) 00010000:00010000:3.0:1782487585.833907:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.833910:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833917:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c0aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833940:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c095 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac0 expref: 690 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833955:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac0 expref: 689 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.833964:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c4bb4800) 00010000:00010000:3.0:1782487585.833967:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.833970:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715aca00, rc 0) 00010000:00010000:2.0:1782487585.833986:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.833997:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834005:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.834049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.834143:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:294423:x1869066294298624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1981us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.834152:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26884 00000100:00100000:2.0:1782487585.834490:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299648 00000100:00100000:2.0:1782487585.834495:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299648 00000100:00100000:2.0:1782487585.834521:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253916660 time 7213253816660 state 0x1 ref 2 00000100:00100000:2.0:1782487585.834547:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253916660 time 7213255936906 state 0x0 ref 2 00000100:00100000:3.0:1782487585.834564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.834564:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1053:294436:x1869066294299648:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.834577:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.834589:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c0db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b22 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834689:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834697:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834703:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834718:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834723:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834728:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834787:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834793:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834799:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.834813:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2a:0x0]: returning size 0 00000004:00200000:2.0:1782487585.834816:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.834824:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834831:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834836:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834840:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834848:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834852:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.834854:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834859:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834866:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.834869:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.834871:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834875:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c0e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.834877:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299776 00000100:00100000:3.0:1782487585.834883:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299776 00010000:00010000:2.0:1782487585.834884:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834889:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834893:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.834898:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.834900:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.834919:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1142 00000100:00100000:3.0:1782487585.834930:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:2362:x1869066294299776:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.834959:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.834970:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85c0f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b1b expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835000:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835003:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835015:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb54b105a00) 00010000:00010000:3.0:1782487585.835017:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835020:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.835026:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835031:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835032:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d800/0x66475b4e8b85c0e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835060:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835069:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835072:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c0db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1057 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835086:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835092:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1056 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835099:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.835101:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.835103:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196ce00, rc 0) 00000100:00100000:2.0:1782487585.835133:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1056:294436:x1869066294299648:12345-192.168.202.21@tcp:101:rm.500 Request processed in 577us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.835140:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26886 00010000:00010000:3.0:1782487585.835177:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835188:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835192:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835199:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835201:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835233:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.835239:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf2:0x0]: returning size 0 00000004:00200000:3.0:1782487585.835244:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00200000:2.0:1782487585.835249:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb30:0x0]: returning size 0 00000004:00200000:2.0:1782487585.835252:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.835259:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.835264:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835280:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835285:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835288:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835302:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835306:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835310:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835318:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835326:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.835327:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835331:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835337:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835353:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e8600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.835353:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.835358:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.835362:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835363:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835380:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c080 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835383:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835392:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835397:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835398:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.835406:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.835407:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835411:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835413:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.835416:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835424:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c0fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835425:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835444:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb54b105c00) 00010000:00010000:2.0:1782487585.835447:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.835451:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835451:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835464:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c0d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835468:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835477:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835483:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.835488:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c079 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af8 expref: 689 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835489:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835509:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835519:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af8 expref: 688 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835524:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb567654b00) 00010000:00010000:3.0:1782487585.835530:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.835530:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487585.835535:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835535:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.835540:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196d200, rc 0) 00010000:00010000:3.0:1782487585.835547:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c105 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835549:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.835562:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85c11a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477aff expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835586:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835592:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85c0f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b1b expref: 1056 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835596:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835633:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835634:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b1b expref: 1055 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835652:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:3.0:1782487585.835655:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.835658:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343400, rc 0) 00010000:00010000:2.0:1782487585.835660:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835664:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.835671:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835675:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85c12f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b29 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835680:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835709:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835720:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835730:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835748:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835756:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835765:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835767:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835783:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835791:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.835808:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb37:0x0]: returning size 0 00010000:00010000:3.0:1782487585.835812:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.835812:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487585.835822:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.835825:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835831:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835838:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835840:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.835847:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835849:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835866:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835874:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835875:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835885:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.835894:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.835895:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835900:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.835905:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835915:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8400/0x66475b4e8b85c136 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835916:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835937:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.835939:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835940:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.835946:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835951:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835956:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85c121 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835962:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835970:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d8c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.835973:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835975:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.835989:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.835992:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836005:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836010:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb567654900) 00010000:00010000:2.0:1782487585.836011:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.836016:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836017:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.836023:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836024:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836041:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d8c00/0x66475b4e8b85c13d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836042:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb54b105700) 00010000:00010000:2.0:1782487585.836048:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.836051:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836057:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85c128 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836076:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85c12f lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b29 expref: 1056 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836084:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92da00/0x66475b4e8b85c11a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aff expref: 690 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836090:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.836095:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.836098:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aff expref: 689 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.836103:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343600/0x66475b4e8b85c12f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b29 expref: 1056 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836106:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:2.0:1782487585.836112:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.836115:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467570a00, rc 0) 00010000:00010000:2.0:1782487585.836119:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.836123:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343600, rc -2) 00010000:00010000:2.0:1782487585.836126:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b85c14b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b06 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836149:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836157:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836168:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.836170:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:2362:x1869066294299776:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1241us (1611us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487585.836187:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1142 00010000:00010000:2.0:1782487585.836255:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836262:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836268:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.836292:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294416:x1869066294298880:12345-192.168.202.21@tcp:101:rm.500 Request processed in 3852us (7254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.836302:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26885 00000100:00100000:3.0:1782487585.836308:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253916660 time 7213255936906 state 0x2 ref 0 00010000:00010000:2.0:1782487585.836354:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836364:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836372:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.836387:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb39:0x0]: returning size 0 00000004:00200000:2.0:1782487585.836391:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.836400:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836407:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836412:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836416:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836421:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836425:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.836427:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836431:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836438:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.836441:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.836443:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836447:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c152 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836455:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836460:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836466:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836471:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.836475:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836482:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836493:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb57f753000) 00010000:00010000:2.0:1782487585.836496:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.836499:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836506:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85c159 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836534:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570600/0x66475b4e8b85c14b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b06 expref: 690 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836549:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b06 expref: 689 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836557:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5d1ac00) 00010000:00010000:2.0:1782487585.836559:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.836562:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56da25200, rc 0) 00010000:00010000:2.0:1782487585.836568:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.836577:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c167 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b0d expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836600:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836646:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836656:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836672:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836681:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836689:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836756:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836765:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836773:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.836787:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb38:0x0]: returning size 0 00000004:00200000:2.0:1782487585.836789:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.836800:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836809:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836817:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836823:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836830:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836836:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb576a0c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.836840:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836847:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836857:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.836861:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.836864:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836870:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb576a0c800/0x66475b4e8b85c16e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836882:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836889:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836896:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836902:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.836906:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836913:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836923:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4b6109600) 00010000:00010000:2.0:1782487585.836927:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.836930:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836937:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85c175 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836968:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c167 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b0d expref: 691 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836983:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b0d expref: 690 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.836991:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487585.836994:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.836997:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f586a00, rc 0) 00000100:00100000:2.0:1782487585.837041:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45ac5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:2361:x1869066294299392:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 7840us (8354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.837050:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1140 00000100:00100000:3.0:1782487585.839426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.839457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.839481:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.839484:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300032 00000100:00100000:2.0:1782487585.839491:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300032 00000100:00100000:3.0:1782487585.839512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.839543:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299904 00000100:00100000:2.0:1782487585.839548:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299904 00000100:00100000:2.0:1782487585.839574:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300160 00000100:00100000:2.0:1782487585.839577:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300160 00000100:00100000:3.0:1782487585.839591:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16143 00000100:00100000:3.0:1782487585.839919:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2362:x1869066294300032:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.839933:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.839950:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b61 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.839960:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16144 00000100:00100000:2.0:1782487585.839971:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2361:x1869066294299904:12345-192.168.202.21@tcp:101:rm.500 00002000:00010000:3.0:1782487585.839979:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1868:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.839979:0:213223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.839988:0:213223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b5a expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.839997:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.840003:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.840003:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.840010:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.840020:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 134 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840020:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 81 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840050:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 134 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840054:0:213223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 81 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840079:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d8c00, rc 0) 00010000:00010000:2.0:1782487585.840081:0:213223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587600, rc 0) 00000100:00100000:3.0:1782487585.840127:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066294300032:12345-192.168.202.21@tcp:101:rm.500 Request processed in 207us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.840128:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2361:x1869066294299904:12345-192.168.202.21@tcp:101:rm.500 Request processed in 151us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.840143:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16143 00000100:00100000:2.0:1782487585.840151:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16144 00000100:00100000:3.0:1782487585.840168:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16145 00000100:00100000:3.0:1782487585.840179:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2363:x1869066294300160:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.840187:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.840198:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b68 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.840225:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1864:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.840236:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.840240:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.840247:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 134 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.840247:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299136 00000100:00100000:2.0:1782487585.840254:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299136 00010000:00010000:3.0:1782487585.840265:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 134 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840276:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d8400, rc 0) 00000100:00100000:2.0:1782487585.840277:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213253916660 time 7213255936906 state 0x0 ref 1 00000100:00100000:2.0:1782487585.840289:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213256036906 time 7213255936906 state 0x1 ref 1 00000100:00100000:2.0:1782487585.840313:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213256036906 time 7213261702892 state 0x0 ref 1 00000100:00100000:2.0:1782487585.840324:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4545ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294418:x1869066294299136:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.840341:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.840353:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85c198 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ace expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.840383:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2363:x1869066294300160:12345-192.168.202.21@tcp:101:rm.500 Request processed in 205us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.840391:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16145 00010000:00010000:2.0:1782487585.840407:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840417:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840424:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840435:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840440:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840445:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.840453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.840515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.840524:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300288 00010000:00010000:2.0:1782487585.840528:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.840530:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300288 00010000:00010000:2.0:1782487585.840541:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840550:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.840573:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb30:0x0]: returning size 0 00000004:00200000:2.0:1782487585.840577:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1782487585.840580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00010000:2.0:1782487585.840594:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840627:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840638:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840645:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.840655:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300544 00010000:00010000:2.0:1782487585.840656:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.840661:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300544 00010000:00010000:2.0:1782487585.840665:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.840671:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840679:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840692:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.840696:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782487585.840697:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16146 00010000:00010000:2.0:1782487585.840701:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840711:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85c19f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.840713:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16147 00000100:00100000:1.0:1782487585.840713:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2363:x1869066294300288:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.840728:0:213220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.840729:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45156ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2363:x1869066294300544:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.840734:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840739:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.840742:0:213220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b6f expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840743:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840752:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b7d expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840764:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840774:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00002000:00010000:1.0:1782487585.840777:0:213220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1840:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00002000:00010000:3.0:1782487585.840778:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1841:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.840779:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840793:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.840794:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.840795:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840798:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.840804:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.840808:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 109 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840818:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4b6109000) 00010000:00010000:1.0:1782487585.840819:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840827:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.840834:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840835:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 109 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.840857:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85c1a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.840859:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343600, rc 0) 00010000:00010000:1.0:1782487585.840865:0:213220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.840878:0:213220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4af800, rc 0) 00000100:00100000:3.0:1782487585.840884:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45156ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2363:x1869066294300544:12345-192.168.202.21@tcp:101:rm.500 Request processed in 160us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.840890:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16147 00010000:00010000:2.0:1782487585.840899:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85c198 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ace expref: 692 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.840905:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+108:2363:x1869066294300288:12345-192.168.202.21@tcp:101:rm.500 Request processed in 197us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.840914:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299008 00000100:00100000:1.0:1782487585.840917:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16146 00000100:00100000:3.0:1782487585.840918:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299008 00010000:00010000:2.0:1782487585.840926:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ace expref: 692 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.840936:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213261802892 time 7213261702892 state 0x1 ref 2 00010000:00010000:2.0:1782487585.840937:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487585.840944:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.840947:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587000, rc 0) 00000100:00100000:3.0:1782487585.840961:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213261802892 time 7213262352058 state 0x0 ref 2 00000100:00100000:3.0:1782487585.840970:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294415:x1869066294299008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.840976:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.840978:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4545ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294418:x1869066294299136:12345-192.168.202.21@tcp:101:rm.500 Request processed in 655us (1495us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.840985:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c1c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ac7 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.840991:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26887 00010000:00010000:3.0:1782487585.841013:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841021:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841027:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841040:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841046:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841051:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.841161:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841168:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841173:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.841191:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2e:0x0]: returning size 0 00000100:00100000:2.0:1782487585.841192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00200000:3.0:1782487585.841197:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.841220:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841230:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841243:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841250:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.841266:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841271:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e8600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.841274:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841278:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841287:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.841289:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.841293:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841303:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c1c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841317:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841324:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841331:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841337:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.841341:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.841357:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841368:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb567654700) 00010000:00010000:3.0:1782487585.841372:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.841376:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841384:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c1d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.841412:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c1c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac7 expref: 693 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.841418:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300416 00010000:00010000:3.0:1782487585.841423:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac7 expref: 692 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.841424:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300416 00010000:00010000:3.0:1782487585.841435:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4ba768900) 00000100:00100000:2.0:1782487585.841435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.841440:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.841442:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac600, rc 0) 00000100:00100000:1.0:1782487585.841461:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300928 00000100:00100000:1.0:1782487585.841466:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300928 00000100:00100000:2.0:1782487585.841471:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300672 00000100:00100000:3.0:1782487585.841472:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294415:x1869066294299008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 503us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.841478:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300672 00000100:00100000:3.0:1782487585.841481:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26888 00000100:00100000:3.0:1782487585.841486:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213261802892 time 7213262352058 state 0x2 ref 0 00000100:00100000:1.0:1782487585.841503:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16148 00000100:00100000:3.0:1782487585.841504:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299264 00000100:00100000:3.0:1782487585.841508:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299264 00000100:00100000:1.0:1782487585.841518:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+108:2361:x1869066294300416:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:2.0:1782487585.841523:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16149 00000100:00100000:3.0:1782487585.841524:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213261802892 time 7213262352058 state 0x0 ref 1 00010000:00010000:1.0:1782487585.841530:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.841534:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213262452058 time 7213262352058 state 0x1 ref 1 00000100:00100000:2.0:1782487585.841540:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2363:x1869066294300928:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.841545:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b76 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841549:0:200304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.841554:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213262452058 time 7213262943364 state 0x0 ref 1 00010000:00010000:2.0:1782487585.841565:0:200304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b8b expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.841568:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x183f:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:3.0:1782487585.841573:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294420:x1869066294299264:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.841586:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.841588:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1782487585.841593:0:200304:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1869:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487585.841593:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.841600:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c1ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ad5 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841632:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.841638:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.841645:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 136 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841658:0:200304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 136 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841668:0:200304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587a00, rc 0) 00010000:00010000:3.0:1782487585.841670:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841682:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841691:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841694:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2363:x1869066294300928:12345-192.168.202.21@tcp:101:rm.500 Request processed in 158us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.841708:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16149 00010000:00010000:3.0:1782487585.841714:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841723:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841732:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841736:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16150 00000100:00100000:2.0:1782487585.841749:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2361:x1869066294300672:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.841757:0:200304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.841769:0:200304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b84 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487585.841784:0:200304:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1867:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.841796:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.841801:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.841808:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 136 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841812:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841823:0:200304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 136 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841825:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.841845:0:200304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f586600, rc 0) 00010000:00010000:3.0:1782487585.841846:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.841866:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb33:0x0]: returning size 0 00000004:00200000:3.0:1782487585.841870:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1782487585.841872:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2361:x1869066294300672:12345-192.168.202.21@tcp:101:rm.500 Request processed in 124us (487us total) trans 0 rc 0/0 00000004:00010000:3.0:1782487585.841878:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.841884:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16150 00010000:00010000:3.0:1782487585.841889:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841896:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841900:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841905:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841908:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.841911:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841916:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.841916:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 109 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841934:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.841936:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.841939:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.841943:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 109 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841954:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c1f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.841967:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55c00, rc 0) 00010000:00010000:3.0:1782487585.841970:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841975:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841979:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841982:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.841985:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841989:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.841995:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb567654500) 00010000:00010000:3.0:1782487585.841997:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.841999:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.842003:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c1fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.842009:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2361:x1869066294300416:12345-192.168.202.21@tcp:101:rm.500 Request processed in 495us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.842018:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16148 00010000:00010000:3.0:1782487585.842022:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c1ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ad5 expref: 694 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.842037:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ad5 expref: 693 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.842042:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487585.842044:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.842047:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c600, rc 0) 00000100:00100000:3.0:1782487585.842072:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb455fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+693:294420:x1869066294299264:12345-192.168.202.21@tcp:101:rm.500 Request processed in 505us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.842080:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26889 00000100:00100000:3.0:1782487585.842085:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213262452058 time 7213262943364 state 0x2 ref 0 00000100:00100000:3.0:1782487585.842115:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294300800 00000100:00100000:3.0:1782487585.842181:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294300800 00000100:00100000:3.0:1782487585.842484:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301056 00000100:00100000:3.0:1782487585.842488:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301056 00000100:00100000:3.0:1782487585.842515:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1154 00000100:00100000:3.0:1782487585.842522:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+694:2361:x1869066294300800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.842530:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.842542:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85bfb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a96 expref: 694 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.842552:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb54b105d00) 00010000:00010000:3.0:1782487585.842604:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.842698:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+693:2361:x1869066294300800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.842707:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1154 00000100:00100000:3.0:1782487585.842743:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1155 00000100:00100000:3.0:1782487585.842754:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:2361:x1869066294301056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.842763:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.842774:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c0cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac0 expref: 692 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.842784:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c4bb4800) 00010000:00010000:3.0:1782487585.842787:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.842805:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:2361:x1869066294301056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 55us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.842811:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1155 00000100:00100000:2.0:1782487585.842831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.842866:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294299520 00000100:00100000:3.0:1782487585.842869:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294299520 00000100:00100000:2.0:1782487585.842954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.842987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.843154:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213262452058 time 7213262943364 state 0x0 ref 1 00000100:00100000:3.0:1782487585.843161:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213263043364 time 7213262943364 state 0x1 ref 1 00000100:00100000:2.0:1782487585.843168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.843220:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301184 00000100:00100000:2.0:1782487585.843225:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301184 00000100:00100000:3.0:1782487585.843247:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301440 00000100:00100000:3.0:1782487585.843251:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301440 00000100:00100000:3.0:1782487585.843265:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213263043364 time 7213262943364 state 0x1 ref 2 00000100:00100000:2.0:1782487585.843269:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1156 00000100:00100000:2.0:1782487585.843282:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:2361:x1869066294301184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487585.843285:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264775262 time 7213264675262 state 0x1 ref 2 00010000:00010000:2.0:1782487585.843296:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487585.843302:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294431:x1869066294299520:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.843312:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.843313:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c0bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ab2 expref: 692 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843324:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c20f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b14 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843329:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:2.0:1782487585.843337:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487585.843369:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:2361:x1869066294301184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 90us (416us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.843376:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.843378:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1156 00010000:00010000:3.0:1782487585.843390:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843397:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843408:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.843412:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264775262 time 7213264800876 state 0x0 ref 2 00010000:00010000:3.0:1782487585.843415:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843429:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.843435:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1055:294434:x1869066294301440:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.843448:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.843487:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843493:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843498:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.843514:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb38:0x0]: returning size 0 00000004:00200000:3.0:1782487585.843516:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.843525:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843571:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843579:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843586:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843593:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843597:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c22b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b92 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843600:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.843627:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843636:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843653:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.843655:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.843657:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843662:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85c216 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843671:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843675:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843680:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843684:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.843687:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843691:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843696:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb567654200) 00010000:00010000:3.0:1782487585.843698:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.843700:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843704:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85c21d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843726:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c20f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b14 expref: 692 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843736:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b14 expref: 691 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.843741:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.843743:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.843745:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6200, rc 0) 00000100:00100000:3.0:1782487585.843765:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:294431:x1869066294299520:12345-192.168.202.21@tcp:101:rm.500 Request processed in 469us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.843774:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26890 00010000:00010000:2.0:1782487585.843779:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843791:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843800:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843816:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843824:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.843832:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487585.844436:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186a:0x0], index 0: 0 00000100:00100000:3.0:1782487585.844657:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301568 00000100:00100000:3.0:1782487585.844662:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301568 00000100:00100000:3.0:1782487585.844694:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16151 00000100:00100000:3.0:1782487585.844704:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2362:x1869066294301568:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.844714:0:213384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.844729:0:213384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477b99 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.844751:0:213384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1843:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.844761:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.844764:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.844770:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 82 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844779:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c247 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.844780:0:213384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 82 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.844801:0:213384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196d800, rc 0) 00010000:00010000:2.0:1782487585.844802:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844813:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.844834:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2362:x1869066294301568:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 131us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.844842:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16151 00010000:00010000:2.0:1782487585.844847:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844855:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844862:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844868:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.844872:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844880:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844893:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.844896:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.844900:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.844911:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c232 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.844919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00010000:2.0:1782487585.844928:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003300ab0d reply state 000000008abe275b transno 8589956782 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.844937:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.844955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.844966:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c22b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b92 expref: 1058 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.844981:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301696 00010000:00010000:2.0:1782487585.844987:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c247 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b92 expref: 1057 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.844987:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301696 00000100:00100000:3.0:1782487585.844992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.845001:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb54b105c00) 00010000:00010000:2.0:1782487585.845004:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.845007:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7600, rc 0) 00000100:00100000:1.0:1782487585.845019:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301824 00000100:00100000:3.0:1782487585.845020:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294301952 00000100:00100000:1.0:1782487585.845023:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301824 00000100:00100000:3.0:1782487585.845025:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294301952 00000100:00100000:2.0:1782487585.845049:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1058:294434:x1869066294301440:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1617us (2062us total) trans 8589956782 rc 0/0 00000100:00100000:1.0:1782487585.845055:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16152 00000100:00100000:2.0:1782487585.845058:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26891 00000100:00100000:2.0:1782487585.845064:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264775262 time 7213264800876 state 0x2 ref 0 00000100:00100000:3.0:1782487585.845068:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16153 00000100:00100000:1.0:1782487585.845069:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2360:x1869066294301696:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487585.845079:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.845083:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2360:x1869066294301824:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.845089:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.845093:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ba0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.845101:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ba7 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.845106:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x183d:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00002000:00010000:3.0:1782487585.845115:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x183e:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487585.845117:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.845121:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.845127:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.845127:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 113 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.845129:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16154 00010000:00010000:3.0:1782487585.845135:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487585.845143:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066294301952:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.845146:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 113 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.845148:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 113 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.845153:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.845165:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bae expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.845170:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54200, rc 0) 00010000:00010000:3.0:1782487585.845173:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 113 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.845192:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467570600, rc 0) 00000100:00100000:1.0:1782487585.845194:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066294301696:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 130us (275us total) trans 0 rc 0/0 00002000:00010000:2.0:1782487585.845195:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1842:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:1.0:1782487585.845218:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16152 00000100:00100000:3.0:1782487585.845227:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb451568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066294301824:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 148us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.845233:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16153 00010000:00010000:2.0:1782487585.845247:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.845253:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.845261:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 112 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.845275:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 112 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.845286:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7e00, rc 0) 00000100:00100000:2.0:1782487585.845320:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2360:x1869066294301952:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 179us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.845329:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16154 00000100:00100000:3.0:1782487585.845444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.845492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.845520:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302080 00000100:00100000:2.0:1782487585.845524:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302080 00000100:00100000:3.0:1782487585.845543:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.845552:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302208 00000100:00100000:2.0:1782487585.845555:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302208 00000100:00100000:3.0:1782487585.845629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.845760:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302336 00000100:00100000:3.0:1782487585.845764:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302336 00000100:00100000:3.0:1782487585.845791:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302464 00000100:00100000:3.0:1782487585.845793:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302464 00000100:00100000:3.0:1782487585.845812:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1157 00000100:00100000:3.0:1782487585.845818:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:2361:x1869066294302336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.845825:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.845837:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c1d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ac7 expref: 692 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.845847:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487585.845849:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.845868:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:2361:x1869066294302336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 51us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.845873:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1157 00000100:00100000:3.0:1782487585.845887:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1158 00000100:00100000:3.0:1782487585.845893:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:2361:x1869066294302464:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.845898:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.845906:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85c1ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ace expref: 690 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.845915:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487585.845917:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.845930:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:2361:x1869066294302464:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.845935:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1158 00000100:00100000:1.0:1782487585.846313:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16155 00000100:00100000:1.0:1782487585.846323:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2361:x1869066294302080:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.846330:0:213220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.846337:0:213220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bb5 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846348:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.846350:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.846355:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 113 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846364:0:213220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 113 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846370:0:213220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54800, rc 0) 00000100:00100000:1.0:1782487585.846390:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2361:x1869066294302080:12345-192.168.202.21@tcp:101:rm.500 Request processed in 69us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.846395:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16155 00000100:00100000:2.0:1782487585.846409:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16156 00000100:00100000:2.0:1782487585.846419:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2362:x1869066294302208:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.846426:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.846439:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bbc expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.846446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00002000:00010000:2.0:1782487585.846458:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1866:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:1.0:1782487585.846469:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302848 00010000:00010000:2.0:1782487585.846474:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=7213s v=(0 0) 00000100:00100000:1.0:1782487585.846474:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302848 00010000:00010000:2.0:1782487585.846480:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.846488:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 137 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.846499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.846507:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16157 00010000:00010000:2.0:1782487585.846508:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 137 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.846517:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2361:x1869066294302848:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.846518:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad6800, rc 0) 00010000:00010000:1.0:1782487585.846528:0:213226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.846539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.846540:0:213226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bca expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.846546:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2362:x1869066294302208:12345-192.168.202.21@tcp:101:rm.500 Request processed in 128us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.846560:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16156 00010000:00010000:1.0:1782487585.846564:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.846570:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.846577:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 114 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.846578:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302592 00000100:00100000:2.0:1782487585.846582:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302592 00000100:00100000:3.0:1782487585.846588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.846600:0:213226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 115 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.846625:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16158 00000100:00100000:2.0:1782487585.846631:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2363:x1869066294302592:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.846637:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.846644:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bc3 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.846655:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.846659:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.846665:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 116 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.846678:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 116 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.846689:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad6000, rc 0) 00000100:00100000:3.0:1782487585.846709:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302720 00000100:00100000:3.0:1782487585.846714:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302720 00000100:00100000:2.0:1782487585.846725:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2363:x1869066294302592:12345-192.168.202.21@tcp:101:rm.500 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.846733:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16158 00000100:00100000:2.0:1782487585.846781:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294302976 00000100:00100000:2.0:1782487585.846785:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294302976 00000100:00100000:2.0:1782487585.846804:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264775262 time 7213264800876 state 0x0 ref 1 00000100:00100000:2.0:1782487585.846812:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264900876 time 7213264800876 state 0x1 ref 1 00000100:00100000:2.0:1782487585.846832:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264900876 time 7213268222614 state 0x0 ref 1 00000100:00100000:2.0:1782487585.846842:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294394:x1869066294302976:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.846849:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.846857:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c286 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bd1 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.846868:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1159 00000100:00100000:3.0:1782487585.846877:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:2361:x1869066294302720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487585.846885:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.846889:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.846896:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85c224 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b14 expref: 691 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.846897:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846916:0:213226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fc71800, rc 0) 00010000:00010000:2.0:1782487585.846917:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.846919:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487585.846926:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.846935:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.846941:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2361:x1869066294302848:12345-192.168.202.21@tcp:101:rm.500 Request processed in 424us (497us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.846945:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.846951:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:2361:x1869066294302720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 73us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.846951:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16157 00010000:00010000:2.0:1782487585.846958:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.846963:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1159 00010000:00010000:1.0:1782487585.846985:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846992:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.846997:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.847001:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.847005:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.847012:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.847022:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb54b105700) 00010000:00010000:1.0:1782487585.847025:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.847027:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.847032:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c239 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847036:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847047:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847055:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.847077:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb2a:0x0]: returning size 0 00000004:00200000:2.0:1782487585.847082:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.847094:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847105:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847113:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847120:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847127:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847137:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.847142:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847149:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847161:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.847163:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.847166:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847171:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c28d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847182:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847186:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847190:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847195:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.847198:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847202:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847250:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487585.847254:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.847258:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847264:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c294 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847301:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c286 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd1 expref: 690 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847328:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd1 expref: 689 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847337:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.847340:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.847343:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48b446e00, rc 0) 00000100:00100000:2.0:1782487585.847379:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:294394:x1869066294302976:12345-192.168.202.21@tcp:101:rm.500 Request processed in 539us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.847387:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26892 00000100:00100000:2.0:1782487585.847392:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264900876 time 7213268222614 state 0x2 ref 0 00000100:00100000:3.0:1782487585.847828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.847860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.847880:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294303360 00000100:00100000:3.0:1782487585.847884:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294303360 00000100:00100000:3.0:1782487585.847896:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213264900876 time 7213268222614 state 0x0 ref 1 00000100:00100000:3.0:1782487585.847903:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213268322614 time 7213268222614 state 0x1 ref 1 00000100:00100000:3.0:1782487585.847918:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294303488 00000100:00100000:3.0:1782487585.847920:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294303488 00000100:00100000:3.0:1782487585.847932:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213268322614 time 7213268222614 state 0x1 ref 2 00000100:00100000:2.0:1782487585.847943:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213269431352 time 7213269331352 state 0x1 ref 2 00000100:00100000:3.0:1782487585.847953:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213269431352 time 7213269343769 state 0x0 ref 2 00000100:00100000:2.0:1782487585.847960:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1058:294434:x1869066294303360:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487585.847966:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4892f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1058:294441:x1869066294303488:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.847975:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.847982:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c2a2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bd8 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.847993:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.848009:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c247 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b92 expref: 1059 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.848023:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb54b105c00) 00010000:00010000:2.0:1782487585.848033:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.848045:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848053:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848059:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848068:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848073:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848079:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.848084:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.848096:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.848105:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.848228:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d48d6385 reply state 00000000d7e4e1b3 transno 8589956783 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.848237:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.848418:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1060:294434:x1869066294303360:12345-192.168.202.21@tcp:36:touch.500 Request processed in 461us (588us total) trans 8589956783 rc 0/0 00000100:00100000:2.0:1782487585.848427:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26893 00000004:00080000:3.0:1782487585.848495:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1844:0x0], index 1: 0 00010000:00010000:3.0:1782487585.848673:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c2be lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848681:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848687:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848712:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848719:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848727:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848733:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.848738:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848743:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848751:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.848753:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.848756:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848760:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c2a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.848769:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066d51f33 reply state 000000009d489c48 transno 8589956784 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.848773:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.848790:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c2a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd8 expref: 1061 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848805:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c2be lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd8 expref: 1060 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.848810:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb567654700) 00010000:00010000:3.0:1782487585.848812:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.848814:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac000, rc 0) 00000100:00100000:3.0:1782487585.848846:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4892f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1061:294441:x1869066294303488:12345-192.168.202.21@tcp:101:touch.500 Request processed in 884us (987us total) trans 8589956784 rc 0/0 00000100:00100000:3.0:1782487585.848851:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26894 00000100:00100000:3.0:1782487585.848855:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213269431352 time 7213269343769 state 0x2 ref 0 00000100:00100000:3.0:1782487585.849180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.849228:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294303744 00010000:00010000:1.0:1782487585.849233:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.849234:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294303744 00010000:00010000:1.0:1782487585.849242:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.849247:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.849251:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.849254:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.849256:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213269431352 time 7213269343769 state 0x0 ref 1 00010000:00010000:1.0:1782487585.849259:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.849273:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213269443769 time 7213269343769 state 0x1 ref 1 00010000:00010000:1.0:1782487585.849274:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb543a0da00) 00010000:00010000:1.0:1782487585.849278:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.849283:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.849287:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c2b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.849306:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213269443769 time 7213270695724 state 0x0 ref 1 00000100:00100000:2.0:1782487585.849321:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:294394:x1869066294303744:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.849347:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.849363:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c29b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd1 expref: 689 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849385:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85b8c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4778ac expref: 688 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849399:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.849404:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.849418:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849428:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849436:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849465:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849473:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849479:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849555:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849567:0:213684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1059 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849580:0:213684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849633:0:213684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1059 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.849648:0:213684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1059 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.849662:0:213684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a60b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299219200:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487585.849746:0:213684:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4518e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487585.849961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.850083:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294303872 00000100:00100000:3.0:1782487585.850087:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294303872 00010000:00010000:1.0:1782487585.850091:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850098:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850103:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.850104:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213270795724 time 7213270695724 state 0x1 ref 2 00000100:00100000:2.0:1782487585.850112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.850119:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.850121:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850126:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.850136:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304256 00010000:00010000:1.0:1782487585.850136:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb567654500) 00000100:00100000:3.0:1782487585.850141:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304256 00010000:00010000:1.0:1782487585.850141:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.850145:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850150:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c2b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.850156:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213270795724 time 7213270695724 state 0x1 ref 3 00000100:00100000:3.0:1782487585.850171:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213271662200 time 7213271562200 state 0x1 ref 3 00000100:00100000:1.0:1782487585.850180:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213271662200 time 7213271569655 state 0x0 ref 3 00000100:00100000:3.0:1782487585.850181:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1060:294434:x1869066294303872:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.850192:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.850198:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1060:294441:x1869066294304256:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.850215:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c2e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bdf expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850239:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.850251:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c2be lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bd8 expref: 1060 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850261:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb567654700) 00000100:00100000:2.0:1782487585.850271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.850273:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.850294:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bdf expref: 1060 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.850300:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304384 00000100:00100000:2.0:1782487585.850306:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304384 00010000:00010000:1.0:1782487585.850306:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.850308:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bdf expref: 1060 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850321:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.850329:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.850331:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213271669655 time 7213271569655 state 0x1 ref 4 00010000:00010000:3.0:1782487585.850333:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:3.0:1782487585.850339:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.850343:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07000, rc 0) 00000100:00100000:2.0:1782487585.850362:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213271669655 time 7213271752180 state 0x0 ref 4 00000100:00100000:2.0:1782487585.850376:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1062:294442:x1869066294304384:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:3.0:1782487585.850380:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1062:294434:x1869066294303872:12345-192.168.202.21@tcp:101:touch.500 Request processed in 199us (418us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.850388:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.850392:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26896 00000004:00010000:1.0:1782487585.850400:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d713f0ca reply state 000000003b7afff8 transno 8589956785 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850402:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c2ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477be6 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.850414:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.850454:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1063:294441:x1869066294304256:12345-192.168.202.21@tcp:36:touch.500 Request processed in 259us (348us total) trans 8589956785 rc 0/0 00000100:00100000:1.0:1782487585.850461:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26897 00010000:00010000:2.0:1782487585.850733:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850746:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850755:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850771:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850780:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.850789:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.850922:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:2.0:1782487585.851337:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186b:0x0], index 0: 0 00010000:00010000:1.0:1782487585.851429:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.851438:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.851439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.851446:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.851451:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.851454:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.851459:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.851466:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:1.0:1782487585.851469:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.851471:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.851475:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c2e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.851487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.851512:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304640 00000100:00100000:3.0:1782487585.851515:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304640 00000100:00100000:3.0:1782487585.851529:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213271852180 time 7213271752180 state 0x1 ref 3 00000100:00100000:3.0:1782487585.851548:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213271852180 time 7213272939305 state 0x0 ref 3 00000100:00100000:3.0:1782487585.851620:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1063:294441:x1869066294304640:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.851628:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.851638:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c304 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bed expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851656:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c30b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.851664:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bed expref: 1064 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.851674:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bed expref: 1064 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.851683:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb567654200) 00010000:00010000:3.0:1782487585.851685:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.851687:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e8600, rc 0) 00010000:00010000:2.0:1782487585.851709:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c30b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851717:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c30b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.851718:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1064:294441:x1869066294304640:12345-192.168.202.21@tcp:101:touch.500 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.851738:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26899 00010000:00010000:2.0:1782487585.851745:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851752:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851756:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851761:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474400a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.851764:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851768:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851775:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.851777:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.851780:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851783:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c2f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.851792:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ede21dd reply state 00000000c2a135d1 transno 8589956786 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.851796:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.851813:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c2ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477be6 expref: 1064 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851824:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c30b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477be6 expref: 1063 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.851829:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:2.0:1782487585.851831:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.851833:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454f51c00, rc 0) 00000100:00100000:2.0:1782487585.851943:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1064:294442:x1869066294304384:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1568us (1676us total) trans 8589956786 rc 0/0 00000100:00100000:2.0:1782487585.851953:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26898 00000100:00100000:2.0:1782487585.851986:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304768 00000100:00100000:2.0:1782487585.851991:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304768 00000100:00100000:2.0:1782487585.852113:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16159 00000100:00100000:2.0:1782487585.852125:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2360:x1869066294304768:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487585.852403:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2360:x1869066294304768:12345-192.168.202.21@tcp:2:touch.500 Request processed in 279us (914us total) trans 8589940657 rc 0/0 00000100:00100000:2.0:1782487585.852411:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16159 00000100:00100000:2.0:1782487585.852442:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304512 00000100:00100000:2.0:1782487585.852447:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304512 00010000:00010000:2.0:1782487585.852636:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1064 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.852723:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6147 00000100:00100000:2.0:1782487585.852733:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545575450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1064:2361:x1869066294304512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487585.852743:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.852750:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1064 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.852765:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1064 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.852781:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.852785:0:190284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.852798:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.852806:0:190284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.852822:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487585.852856:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545575450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1064:2361:x1869066294304512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 125us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.852865:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6147 00010000:00010000:2.0:1782487585.852960:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c0f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b22 expref: 1063 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.852976:0:213684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a60b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:213684:1869066299219200:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487585.852998:0:213684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.853008:0:213684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.853014:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.853418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.853443:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294304896 00000100:00100000:1.0:1782487585.853448:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294304896 00000100:00100000:1.0:1782487585.853480:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16160 00000100:00100000:1.0:1782487585.853488:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2363:x1869066294304896:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.853502:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.853559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.853591:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294305024 00000100:00100000:3.0:1782487585.853596:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294305024 00000100:00100000:1.0:1782487585.853822:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2363:x1869066294304896:12345-192.168.202.21@tcp:2:touch.500 Request processed in 334us (407us total) trans 8589939996 rc 0/0 00000100:00100000:1.0:1782487585.853829:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16160 00010000:00010000:1.0:1782487585.853856:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853862:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853867:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853873:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.853877:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853882:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853890:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb543a0de00) 00010000:00010000:1.0:1782487585.853893:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.853895:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.853899:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c2fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.853923:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294305280 00000100:00100000:1.0:1782487585.853926:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294305280 00000100:00100000:1.0:1782487585.853944:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213273039305 time 7213272939305 state 0x1 ref 2 00000040:00080000:2.0:1782487585.853960:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2523, 64 off169664 00000100:00100000:1.0:1782487585.853965:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213273039305 time 7213275354883 state 0x0 ref 2 00000100:00100000:1.0:1782487585.853974:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1063:294442:x1869066294305280:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487585.853991:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213275454883 time 7213275354883 state 0x1 ref 3 00010000:00010000:1.0:1782487585.854010:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487585.854019:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213275454883 time 7213275408345 state 0x0 ref 3 00010000:00010000:1.0:1782487585.854027:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c30b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477be6 expref: 1063 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.854034:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1063:294436:x1869066294305024:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.854038:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.854046:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:3.0:1782487585.854048:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.854050:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.854058:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.854061:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854068:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c320 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bf4 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854069:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854082:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854095:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.854096:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.854115:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854120:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.854125:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854132:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854135:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854140:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854149:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854151:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854154:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.854159:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854164:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854165:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854183:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.854186:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.854188:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854189:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.854217:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a99e071 reply state 0000000056b9d66a transno 8589956788 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854218:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854236:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.854236:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.854238:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c2da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854263:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854271:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854277:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854284:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.854288:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854295:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.854297:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1065:294442:x1869066294305280:12345-192.168.202.21@tcp:36:touch.500 Request processed in 323us (738us total) trans 8589956788 rc 0/0 00000100:00100000:1.0:1782487585.854312:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26900 00010000:00010000:2.0:1782487585.854324:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.854328:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782487585.854346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.854495:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854501:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c2cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854532:0:190298:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.854542:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.854552:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002df20566 reply state 000000008b802051 transno 8589956787 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.854566:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.854870:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+689:294394:x1869066294303744:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5551us (5687us total) trans 8589956787 rc 0/0 00000100:00100000:2.0:1782487585.854878:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26895 00010000:00010000:2.0:1782487585.854907:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.854912:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854918:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.854921:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854926:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854936:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2a:0x0].0x0 (ffff9cb4664e1f00) 00010000:00010000:2.0:1782487585.854938:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.854940:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854944:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c319 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.854955:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.854957:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.854959:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487585.854974:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294305536 00000100:00100000:2.0:1782487585.854979:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294305536 00010000:00010000:1.0:1782487585.855001:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.855004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.855013:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855014:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294305792 00000100:00100000:2.0:1782487585.855020:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294305792 00010000:00010000:1.0:1782487585.855023:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855030:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.855035:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855042:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855046:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5747 00010000:00010000:1.0:1782487585.855059:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb54b105c00) 00000100:00100000:2.0:1782487585.855060:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1066:294434:x1869066294305536:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487585.855066:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.855071:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855082:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c327 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.855118:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5748 00000100:00100000:1.0:1782487585.855128:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1065:294441:x1869066294305792:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.855265:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1067:294434:x1869066294305536:12345-192.168.202.21@tcp:35:touch.500 Request processed in 208us (919us total) trans 8589956789 rc 0/0 00000100:00100000:2.0:1782487585.855274:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5747 00000100:00100000:1.0:1782487585.855296:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1066:294441:x1869066294305792:12345-192.168.202.21@tcp:35:touch.500 Request processed in 170us (294us total) trans 8589956790 rc 0/0 00000100:00100000:1.0:1782487585.855303:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5748 00000100:00100000:1.0:1782487585.855884:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.855923:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294305920 00010000:00010000:1.0:1782487585.855927:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855928:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294305920 00010000:00010000:1.0:1782487585.855935:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855940:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855945:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.855948:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855952:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213275508345 time 7213275408345 state 0x1 ref 2 00010000:00010000:1.0:1782487585.855954:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855967:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb543a0db00) 00010000:00010000:1.0:1782487585.855969:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.855972:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855977:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213275508345 time 7213277367383 state 0x0 ref 2 00010000:00010000:1.0:1782487585.855980:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.855986:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.855990:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1066:294442:x1869066294305920:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.856000:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.856010:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.856012:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c33c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477bfb expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856017:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.856021:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c2d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856036:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.856051:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c33c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bfb expref: 1067 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.856061:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c33c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bfb expref: 1067 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.856074:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487585.856076:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.856079:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad6a00, rc 0) 00010000:00010000:3.0:1782487585.856091:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856100:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.856106:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1067:294442:x1869066294305920:12345-192.168.202.21@tcp:101:touch.500 Request processed in 119us (222us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.856110:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856120:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac600 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:2.0:1782487585.856121:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26902 00010000:00010000:3.0:1782487585.856125:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856131:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856140:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.856144:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.856147:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856154:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c32e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856167:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856174:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856181:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856187:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715aca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.856191:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856198:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856216:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb543a0db00) 00010000:00010000:3.0:1782487585.856219:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.856223:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856230:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c335 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856301:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c320 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bf4 expref: 1066 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856313:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.856315:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.856320:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c320 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bf4 expref: 1066 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.856331:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00000100:00100000:3.0:1782487585.856368:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1065:294436:x1869066294305024:12345-192.168.202.21@tcp:101:rm.500 Request processed in 2338us (2867us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487585.856376:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26901 00000100:00100000:3.0:1782487585.856381:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213275508345 time 7213277367383 state 0x2 ref 0 00000100:00100000:1.0:1782487585.856775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.856804:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294306176 00000100:00100000:1.0:1782487585.856808:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294306176 00000100:00100000:1.0:1782487585.856827:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213275508345 time 7213277367383 state 0x0 ref 1 00000100:00100000:1.0:1782487585.856836:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213277467383 time 7213277367383 state 0x1 ref 1 00000100:00100000:1.0:1782487585.856859:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213277467383 time 7213278249561 state 0x0 ref 1 00000100:00100000:1.0:1782487585.856870:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294412:x1869066294306176:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.856899:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782487585.856914:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85bc90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779d2 expref: 688 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.856932:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85bba9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477993 expref: 687 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.856955:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85ba13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477915 expref: 686 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.856966:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2d:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487585.856974:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.856988:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.856997:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857005:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857020:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857027:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857036:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857120:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857128:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857136:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.857700:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2530, 64 off170112 00010000:00010000:1.0:1782487585.857780:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857790:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857798:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857807:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857814:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857820:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857838:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.857851:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857855:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.857859:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857861:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857871:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857873:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.857878:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857881:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.857885:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857887:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857898:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2d:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:1.0:1782487585.857899:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857902:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.857907:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857913:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c358 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857914:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2d:0x0].0x0 (ffff9cb4549e8d00) 00010000:00010000:1.0:1782487585.857919:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.857923:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857927:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.857929:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c351 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.857930:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.857934:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.857951:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857958:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857964:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857971:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.857975:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857981:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.857991:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.857993:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.857997:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.858007:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c343 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.858018:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a4e210c reply state 00000000de6d8f08 transno 8589956791 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.858026:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.858075:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294412:x1869066294306176:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1205us (1300us total) trans 8589956791 rc 0/0 00000100:00100000:1.0:1782487585.858083:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26903 00000100:00100000:1.0:1782487585.858089:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213277467383 time 7213278249561 state 0x2 ref 0 00000100:00100000:3.0:1782487585.860284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.860318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.860380:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294306560 00000100:00100000:2.0:1782487585.860387:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294306560 00010000:00010000:1.0:1782487585.860392:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.860402:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.860412:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213277467383 time 7213278249561 state 0x0 ref 1 00010000:00010000:1.0:1782487585.860417:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.860426:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213278349561 time 7213278249561 state 0x1 ref 1 00010000:00010000:1.0:1782487585.860426:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.860432:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.860441:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860442:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294306304 00000100:00100000:3.0:1782487585.860447:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294306304 00000100:00100000:2.0:1782487585.860452:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294306816 00010000:00010000:1.0:1782487585.860457:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb54b105700) 00000100:00100000:2.0:1782487585.860458:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294306816 00010000:00010000:1.0:1782487585.860464:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.860469:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860475:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16161 00010000:00010000:1.0:1782487585.860476:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c34a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.860480:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213278349561 time 7213278249561 state 0x1 ref 2 00000100:00100000:3.0:1782487585.860485:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2363:x1869066294306304:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487585.860512:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282001321 time 7213281901321 state 0x1 ref 2 00000100:00100000:2.0:1782487585.860528:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1065:294444:x1869066294306560:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.860542:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.860556:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c35f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c02 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.860705:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.860719:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.860729:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860739:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2363:x1869066294306304:12345-192.168.202.21@tcp:2:touch.500 Request processed in 257us (458us total) trans 8589940658 rc 0/0 00010000:00010000:2.0:1782487585.860744:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860749:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16161 00010000:00010000:2.0:1782487585.860762:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.860770:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.860780:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282001321 time 7213282169838 state 0x0 ref 2 00000100:00100000:3.0:1782487585.860791:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+686:294417:x1869066294306816:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.860814:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.860828:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85bc74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779cb expref: 686 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860844:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85bc97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779d9 expref: 685 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860853:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb54b105d00) 00010000:00010000:3.0:1782487585.860860:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.860869:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860875:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860881:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860892:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860896:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860902:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860967:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860973:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.860979:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487585.861272:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1845:0x0], index 1: 0 00010000:00010000:2.0:1782487585.861517:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c389 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861528:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861538:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c389 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861573:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861581:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861588:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861594:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.861598:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861641:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861656:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000040:00080000:3.0:1782487585.861659:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2531, 64 off170176 00010000:00010000:2.0:1782487585.861660:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.861665:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861673:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c366 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.861687:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000928dfa09 reply state 00000000fac93404 transno 8589956792 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.861695:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.861722:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c35f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c02 expref: 1068 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861737:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861739:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c389 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c02 expref: 1067 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861758:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.861759:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:2.0:1782487585.861765:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.861769:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc 0) 00010000:00010000:3.0:1782487585.861773:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861783:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861790:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861796:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.861812:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1068:294444:x1869066294306560:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1288us (1493us total) trans 8589956792 rc 0/0 00010000:00010000:3.0:1782487585.861814:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487585.861824:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26904 00010000:00010000:3.0:1782487585.861830:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861842:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861849:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861856:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.861860:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861867:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861877:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb567654500) 00010000:00010000:3.0:1782487585.861880:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.861884:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861891:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c382 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861908:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861916:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861922:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861929:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.861934:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861941:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861951:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.861954:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.861957:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.861964:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c374 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.861977:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c1ee708 reply state 00000000ab827026 transno 8589956793 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.861985:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.862021:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+686:294417:x1869066294306816:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1231us (1614us total) trans 8589956793 rc 0/0 00000100:00100000:3.0:1782487585.862029:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26905 00000100:00100000:3.0:1782487585.862035:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282001321 time 7213282169838 state 0x2 ref 0 00010000:00010000:3.0:1782487585.862061:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.862067:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.862075:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196c000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.862079:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.862087:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.862099:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb31:0x0].0x0 (ffff9cb567654500) 00010000:00010000:3.0:1782487585.862102:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.862106:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.862112:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196c000/0x66475b4e8b85c397 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.862132:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.862136:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.862139:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.862399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.862425:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307072 00000100:00100000:2.0:1782487585.862430:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307072 00000100:00100000:2.0:1782487585.862470:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5749 00000100:00100000:2.0:1782487585.862480:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1068:294442:x1869066294307072:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.862695:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294442:x1869066294307072:12345-192.168.202.21@tcp:35:touch.500 Request processed in 215us (295us total) trans 8589956794 rc 0/0 00000100:00100000:2.0:1782487585.862704:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5749 00010000:00010000:1.0:1782487585.862775:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862782:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862786:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862790:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.862792:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862797:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862805:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb543a0d600) 00010000:00010000:1.0:1782487585.862807:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.862810:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.862814:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c36d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863390:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863399:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863406:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863412:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.863415:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863420:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863428:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb567654700) 00010000:00010000:2.0:1782487585.863430:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.863433:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.863437:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c37b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.863826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.863867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.863906:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307456 00000100:00100000:1.0:1782487585.863914:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307456 00000100:00100000:1.0:1782487585.863931:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282001321 time 7213282169838 state 0x0 ref 1 00000100:00100000:1.0:1782487585.863940:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282269838 time 7213282169838 state 0x1 ref 1 00000100:00100000:1.0:1782487585.863958:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213282269838 time 7213285349272 state 0x0 ref 1 00000100:00100000:3.0:1782487585.863961:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307328 00000100:00100000:3.0:1782487585.863968:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307328 00000100:00100000:1.0:1782487585.863968:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1068:294446:x1869066294307456:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.863980:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.863989:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c39e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c09 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.863994:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213285449272 time 7213285349272 state 0x1 ref 2 00000100:00100000:3.0:1782487585.864021:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213285449272 time 7213285411203 state 0x0 ref 2 00010000:00010000:1.0:1782487585.864025:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864033:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.864038:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+685:294416:x1869066294307328:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.864043:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864054:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864059:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864065:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864070:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.864090:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85bdc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a34 expref: 685 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864114:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85babb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47795b expref: 684 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864127:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c4bb4800) 00010000:00010000:3.0:1782487585.864138:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.864148:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864155:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864156:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864168:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864170:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864185:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864193:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.864213:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf4:0x0]: returning size 0 00000004:00200000:1.0:1782487585.864218:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.864231:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864238:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864243:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864248:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864255:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864255:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864269:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.864275:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864276:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864292:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864301:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.864302:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.864305:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864312:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85c3a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864322:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864326:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864331:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864335:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.864338:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864343:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864349:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4549e8d00) 00010000:00010000:1.0:1782487585.864351:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.864353:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864357:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85c3ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864372:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864381:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85c39e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c09 expref: 1070 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864396:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c09 expref: 1069 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864401:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb567654200) 00010000:00010000:1.0:1782487585.864403:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.864405:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5476fda00, rc 0) 00010000:00010000:3.0:1782487585.864423:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.864432:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.864437:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294446:x1869066294307456:12345-192.168.202.21@tcp:101:rm.500 Request processed in 470us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.864446:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26906 00000100:00100000:1.0:1782487585.864491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.864562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.864623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.864654:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307712 00000100:00100000:1.0:1782487585.864658:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307712 00000100:00100000:1.0:1782487585.864678:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213285511203 time 7213285411203 state 0x1 ref 2 00000100:00100000:1.0:1782487585.864694:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213285511203 time 7213286085571 state 0x0 ref 2 00000100:00100000:1.0:1782487585.864704:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294445:x1869066294307712:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.864711:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.864720:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c3cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c17 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864750:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864760:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864770:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864785:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864794:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864802:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864885:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864892:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864899:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.864913:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf2:0x0]: returning size 0 00000004:00200000:1.0:1782487585.864915:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.864925:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864934:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864941:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864952:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.864956:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2532, 64 off170240 00010000:00010000:1.0:1782487585.864960:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864967:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.864972:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864979:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864989:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.864992:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.864994:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.864999:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85c3d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865009:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865014:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865018:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865019:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865027:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.865033:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865036:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865038:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865055:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487585.865057:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.865060:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865061:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865064:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c3dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865077:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865084:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865088:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865095:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c3cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c17 expref: 1071 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865103:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.865107:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c17 expref: 1070 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865113:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:3.0:1782487585.865114:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865115:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.865119:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4ce00, rc 0) 00010000:00010000:3.0:1782487585.865124:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865129:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865134:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.865137:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865141:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865147:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294445:x1869066294307712:12345-192.168.202.21@tcp:101:rm.500 Request processed in 445us (585us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.865150:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.865153:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1782487585.865154:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26908 00010000:00010000:3.0:1782487585.865157:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865162:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c3c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865171:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307968 00000100:00100000:1.0:1782487585.865174:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307968 00010000:00010000:3.0:1782487585.865175:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865181:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865185:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865188:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286185571 time 7213286085571 state 0x1 ref 2 00010000:00010000:3.0:1782487585.865195:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.865200:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865216:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865221:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286185571 time 7213286611668 state 0x0 ref 2 00010000:00010000:3.0:1782487585.865224:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.865227:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.865230:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865231:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294444:x1869066294307968:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.865241:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c3b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.865249:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000559540d7 reply state 00000000e84a6e93 transno 8589956795 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865252:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487585.865260:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.865267:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c389 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c02 expref: 1070 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.865278:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:1.0:1782487585.865286:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487585.865295:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+685:294416:x1869066294307328:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1262us (1469us total) trans 8589956795 rc 0/0 00000100:00100000:3.0:1782487585.865303:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26907 00010000:00010000:1.0:1782487585.865327:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.865335:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294307584 00010000:00010000:1.0:1782487585.865335:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.865341:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294307584 00010000:00010000:1.0:1782487585.865343:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.865379:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1143 00000100:00100000:3.0:1782487585.865389:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1071:2361:x1869066294307584:12345-192.168.202.21@tcp:63:ll_sa.0 00000004:00010000:1.0:1782487585.865404:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fd6d236 reply state 0000000049138592 transno 8589956796 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865407:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.865411:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.865417:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c3f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c10 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865440:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865446:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1073:294444:x1869066294307968:12345-192.168.202.21@tcp:36:touch.500 Request processed in 216us (841us total) trans 8589956796 rc 0/0 00010000:00010000:3.0:1782487585.865448:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865456:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26909 00010000:00010000:3.0:1782487585.865458:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.865460:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286185571 time 7213286611668 state 0x2 ref 0 00010000:00010000:3.0:1782487585.865475:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865481:0:213491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865486:0:213491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865497:0:213491:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865506:0:213491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865529:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.865533:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865537:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715aca00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.865541:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865545:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865552:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2f:0x0].0x0 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.865554:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.865556:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865561:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c3eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.865578:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.865582:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.865585:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.867072:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867086:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867094:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867100:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.867104:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867112:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867124:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.867127:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.867315:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867325:0:3300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867332:0:3300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867356:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867364:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c3c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867392:0:213491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867399:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867447:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867455:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867462:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867468:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.867471:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867477:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867484:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.867486:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.867488:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867493:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c400 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867502:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867505:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867619:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867625:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.867628:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867633:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867643:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.867645:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.867649:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867656:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c407 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.867666:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.867677:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.867684:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867691:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c3f9 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c10 expref: 1072 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.867694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.867697:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.867704:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867710:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.867714:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867715:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.867724:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c3f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c10 expref: 1072 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.867728:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308096 00010000:00010000:2.0:1782487585.867731:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb54b105700) 00000100:00100000:1.0:1782487585.867734:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308096 00010000:00010000:2.0:1782487585.867735:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.867741:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.867747:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c3f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.867775:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac600, rc -2) 00000100:00100000:1.0:1782487585.867775:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16162 00000100:00100000:1.0:1782487585.867788:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2360:x1869066294308096:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.867798:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.867813:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c1e expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.867822:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:2361:x1869066294307584:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2433us (3329us total) trans 0 rc -2/-2 00002000:00010000:1.0:1782487585.867833:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1844:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:3.0:1782487585.867839:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1143 00010000:00010000:1.0:1782487585.867848:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.867852:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.867859:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 84 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.867869:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 84 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.867877:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8da00, rc 0) 00000100:00100000:1.0:1782487585.867904:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2360:x1869066294308096:12345-192.168.202.21@tcp:101:rm.500 Request processed in 119us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.867910:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16162 00000100:00100000:1.0:1782487585.869269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.869310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.869317:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308224 00000100:00100000:3.0:1782487585.869322:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308224 00000100:00100000:1.0:1782487585.869347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.869370:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1160 00000100:00100000:1.0:1782487585.869378:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308480 00000100:00100000:3.0:1782487585.869383:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:2361:x1869066294308224:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487585.869384:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308480 00010000:00010000:3.0:1782487585.869398:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487585.869410:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286185571 time 7213286611668 state 0x0 ref 1 00010000:00010000:3.0:1782487585.869417:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c3e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c17 expref: 1070 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.869429:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286711668 time 7213286611668 state 0x1 ref 1 00010000:00010000:3.0:1782487585.869437:0:190282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:3.0:1782487585.869443:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487585.869449:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308608 00000100:00100000:1.0:1782487585.869453:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308608 00000100:00100000:1.0:1782487585.869472:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213286711668 time 7213286611668 state 0x1 ref 2 00000100:00100000:3.0:1782487585.869479:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:2361:x1869066294308224:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 99us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.869489:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1160 00000100:00100000:1.0:1782487585.869495:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213290984292 time 7213290884292 state 0x1 ref 2 00000100:00100000:1.0:1782487585.869508:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+684:294427:x1869066294308480:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:3.0:1782487585.869527:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213290984292 time 7213290916132 state 0x0 ref 2 00000100:00100000:3.0:1782487585.869542:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294444:x1869066294308608:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.869544:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487585.869554:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.869563:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c144 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aff expref: 684 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.869568:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c415 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c25 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869588:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85bf92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a88 expref: 683 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869645:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85be49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a57 expref: 682 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869662:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487585.869673:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.869689:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869701:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869710:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.869717:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c415 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c25 expref: 1070 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.869737:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c415 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c25 expref: 1070 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869738:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869756:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869765:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869873:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869883:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.869891:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.869946:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487585.869951:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.869954:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454f51c00, rc 0) 00000100:00100000:3.0:1782487585.869982:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294444:x1869066294308608:12345-192.168.202.21@tcp:101:touch.500 Request processed in 443us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.869990:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26911 00000100:00100000:3.0:1782487585.870147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.870265:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308864 00000100:00100000:3.0:1782487585.870270:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308864 00000100:00100000:3.0:1782487585.870289:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213291016132 time 7213290916132 state 0x1 ref 2 00000100:00100000:3.0:1782487585.870314:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291016132 time 7213291704015 state 0x0 ref 2 00000100:00100000:3.0:1782487585.870366:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294446:x1869066294308864:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.870390:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.870404:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c3ba lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c09 expref: 1070 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870421:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c304 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bed expref: 1069 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870430:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb567654200) 00010000:00010000:3.0:1782487585.870439:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1782487585.870443:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2533, 64 off170304 00010000:00010000:3.0:1782487585.870448:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870459:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870465:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870475:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870479:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870485:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870522:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870533:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870542:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870550:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870557:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870563:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870564:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870580:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.870586:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870591:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.870630:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870637:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870643:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870649:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.870654:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870661:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870671:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb54c47f000) 00010000:00010000:1.0:1782487585.870675:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.870679:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870685:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c42a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870702:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870712:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870720:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870727:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.870730:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870737:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870748:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.870751:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.870755:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870761:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c41c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.870773:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058ac0dc3 reply state 00000000590b76f6 transno 8589956797 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.870782:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.870829:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294427:x1869066294308480:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1323us (1520us total) trans 8589956797 rc 0/0 00000100:00100000:1.0:1782487585.870838:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26910 00010000:00010000:1.0:1782487585.870874:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.870880:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870888:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.870892:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870900:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870913:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb37:0x0].0x0 (ffff9cb54c47f000) 00010000:00010000:1.0:1782487585.870916:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.870919:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870926:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c43f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.870947:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.870950:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.870954:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782487585.870956:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2524, 64 off169728 00010000:00010000:3.0:1782487585.871128:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871136:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871143:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871149:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871155:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871159:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.871165:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.871171:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.871181:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871185:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871189:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871192:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.871195:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871199:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871219:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.871221:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.871224:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871231:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c446 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871241:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871245:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871249:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871253:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715aca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.871256:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871262:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871271:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.871273:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.871277:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871283:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c431 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.871295:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082fb6dd2 reply state 000000003eec029c transno 8589956798 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.871302:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.871352:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294446:x1869066294308864:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1028us (1205us total) trans 8589956798 rc 0/0 00000100:00100000:3.0:1782487585.871360:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26912 00000100:00100000:3.0:1782487585.871366:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291016132 time 7213291704015 state 0x2 ref 0 00010000:00010000:3.0:1782487585.871394:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.871399:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871406:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.871410:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871417:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871429:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf4:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.871432:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.871436:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871441:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c44d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.871456:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.871459:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.871461:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.871594:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294308992 00000100:00100000:3.0:1782487585.871600:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294308992 00000100:00100000:3.0:1782487585.871654:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16163 00000100:00100000:3.0:1782487585.871664:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2361:x1869066294308992:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.871893:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2361:x1869066294308992:12345-192.168.202.21@tcp:2:touch.500 Request processed in 230us (727us total) trans 8589939997 rc 0/0 00000100:00100000:3.0:1782487585.871902:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16163 00010000:00010000:3.0:1782487585.872190:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872198:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872217:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872224:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.872229:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872236:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872247:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.872250:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.872254:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872261:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c423 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.872379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.872405:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294309248 00000100:00100000:3.0:1782487585.872410:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294309248 00000100:00100000:3.0:1782487585.872431:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291016132 time 7213291704015 state 0x0 ref 1 00010000:00010000:2.0:1782487585.872433:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.872446:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291804015 time 7213291704015 state 0x1 ref 1 00010000:00010000:2.0:1782487585.872448:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.872462:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.872468:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.872473:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.872480:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.872481:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291804015 time 7213293869958 state 0x0 ref 1 00010000:00010000:2.0:1782487585.872501:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c5187c00) 00000100:00100000:3.0:1782487585.872504:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294423:x1869066294309248:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.872506:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.872512:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.872520:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c438 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872537:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.872555:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85bfd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ae3 expref: 682 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872576:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85bd93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a2d expref: 681 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872588:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487585.872600:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.872701:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872712:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872721:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872735:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872743:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872751:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872833:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872841:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.872850:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.873272:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2534, 64 off170368 00010000:00010000:3.0:1782487585.873337:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873347:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873356:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873363:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873371:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873377:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873395:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.873408:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873420:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873427:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873434:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.873438:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873446:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873457:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487585.873461:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.873465:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873472:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac600/0x66475b4e8b85c462 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873646:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.873653:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873661:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.873664:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873672:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873683:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb35:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:2.0:1782487585.873687:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.873692:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873699:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c469 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873701:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873720:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873727:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.873731:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.873736:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.873737:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.873741:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.873743:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873750:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873760:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.873763:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.873766:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.873772:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c454 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.873782:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cebf2470 reply state 00000000665a9e0e transno 8589956799 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.873790:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.874001:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294423:x1869066294309248:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1500us (1620us total) trans 8589956799 rc 0/0 00000100:00100000:3.0:1782487585.874010:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26913 00000100:00100000:3.0:1782487585.874015:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291804015 time 7213293869958 state 0x2 ref 0 00000100:00100000:3.0:1782487585.874345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.874392:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294309504 00000100:00100000:2.0:1782487585.874398:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294309504 00000100:00100000:3.0:1782487585.874415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.874422:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213291804015 time 7213293869958 state 0x0 ref 1 00000100:00100000:2.0:1782487585.874433:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213293969958 time 7213293869958 state 0x1 ref 1 00000100:00100000:2.0:1782487585.874467:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213293969958 time 7213295856683 state 0x0 ref 1 00000100:00100000:2.0:1782487585.874480:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294445:x1869066294309504:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.874512:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.874530:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c10c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b1b expref: 1069 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874552:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70000/0x66475b4e8b85bf5a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a81 expref: 1068 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874565:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:2.0:1782487585.874576:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.874590:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874600:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874684:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874700:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874708:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874716:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874810:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874820:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.874828:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.875414:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2525, 64 off169792 00010000:00010000:2.0:1782487585.875503:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875513:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875522:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875530:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875539:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875546:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875565:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.875578:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875585:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.875587:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.875596:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875597:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.875634:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.875638:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875645:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.875651:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875652:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875669:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.875682:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:3.0:1782487585.875686:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.875690:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875695:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf2:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:3.0:1782487585.875698:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edff600/0x66475b4e8b85c485 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875700:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.875706:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875715:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85c47e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.875716:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.875721:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.875726:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.875739:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875751:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875758:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875765:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.875769:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875776:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875787:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.875790:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.875793:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.875800:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85c470 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.875811:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1decb23 reply state 000000003b7b3714 transno 8589956800 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.875819:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.875892:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1069:294445:x1869066294309504:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1413us (1547us total) trans 8589956800 rc 0/0 00000100:00100000:2.0:1782487585.875902:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26914 00000100:00100000:2.0:1782487585.875908:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213293969958 time 7213295856683 state 0x2 ref 0 00000100:00100000:3.0:1782487585.876006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.876036:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310016 00000100:00100000:2.0:1782487585.876042:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310016 00000100:00100000:2.0:1782487585.876060:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213293969958 time 7213295856683 state 0x0 ref 1 00000100:00100000:2.0:1782487585.876069:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213295956683 time 7213295856683 state 0x1 ref 1 00010000:00010000:3.0:1782487585.876077:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.876086:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.876092:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.876095:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213295956683 time 7213297484010 state 0x0 ref 1 00010000:00010000:3.0:1782487585.876106:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.876111:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.876116:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294419:x1869066294310016:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.876123:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.876140:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487585.876144:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.876148:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.876154:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85c45b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876161:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.876181:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85c064 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aab expref: 681 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876217:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85bd00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a03 expref: 680 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876229:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb4c5d1a000) 00010000:00010000:2.0:1782487585.876240:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.876254:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876265:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876274:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876289:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876301:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876310:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876396:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876405:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876413:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.876884:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2526, 64 off169856 00010000:00010000:2.0:1782487585.876970:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876979:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876987:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.876994:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877001:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877007:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877026:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.877037:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877043:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877050:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877056:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.877060:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877067:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877076:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb543a0db00) 00010000:00010000:2.0:1782487585.877079:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.877083:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877090:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c49a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877105:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877112:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877123:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877129:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.877133:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877140:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877151:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.877158:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.877164:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877171:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c48c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.877188:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049fd2b64 reply state 00000000bad39c54 transno 8589956801 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.877196:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.877251:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294419:x1869066294310016:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1138us (1245us total) trans 8589956801 rc 0/0 00000100:00100000:2.0:1782487585.877260:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26915 00000100:00100000:2.0:1782487585.877266:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213295956683 time 7213297484010 state 0x2 ref 0 00000100:00100000:3.0:1782487585.877406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.877508:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310144 00000100:00100000:2.0:1782487585.877513:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310144 00000100:00100000:2.0:1782487585.877558:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1144 00000100:00100000:2.0:1782487585.877571:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:2363:x1869066294310144:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:3.0:1782487585.877586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.877594:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.877643:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c4a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c2c expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.877685:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877687:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310272 00000100:00100000:3.0:1782487585.877694:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310272 00010000:00010000:2.0:1782487585.877698:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877707:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877715:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213295956683 time 7213297484010 state 0x0 ref 1 00010000:00010000:2.0:1782487585.877722:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877727:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213297584010 time 7213297484010 state 0x1 ref 1 00010000:00010000:2.0:1782487585.877736:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877746:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877755:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310400 00000100:00100000:3.0:1782487585.877760:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310400 00000100:00100000:3.0:1782487585.877779:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213297584010 time 7213297484010 state 0x1 ref 2 00010000:00010000:2.0:1782487585.877792:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877801:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299290157 time 7213299190157 state 0x1 ref 2 00010000:00010000:2.0:1782487585.877802:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877812:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.877817:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1070:294449:x1869066294310272:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.877830:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.877831:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.877834:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877843:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877844:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c4bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c3a expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877860:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.877865:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.877869:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877875:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c4af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877887:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877894:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877898:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877901:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877918:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.877919:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877922:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877936:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877937:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877962:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877963:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb543a0d300) 00010000:00010000:2.0:1782487585.877970:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.877975:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877977:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.877990:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c4b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.877994:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878023:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294309760 00010000:00010000:2.0:1782487585.878027:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c4a8 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c2c expref: 682 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878028:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294309760 00010000:00010000:2.0:1782487585.878040:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.878046:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.878051:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c4a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c2c expref: 682 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878059:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5750 00010000:00010000:2.0:1782487585.878067:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc -2) 00010000:00010000:3.0:1782487585.878076:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878087:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878095:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.878106:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:2363:x1869066294310144:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 539us (703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487585.878116:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1144 00000004:00200000:3.0:1782487585.878121:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf3:0x0]: returning size 0 00000004:00200000:3.0:1782487585.878126:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.878141:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878152:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878164:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878170:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878177:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878183:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e8600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.878188:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878195:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878214:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1072:294444:x1869066294309760:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487585.878217:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.878222:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.878226:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878233:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e8600/0x66475b4e8b85c4c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878246:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878246:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878267:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878268:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878288:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878288:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878306:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.878310:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.878312:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878316:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878324:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878328:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878340:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.878345:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.878346:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb543a0d800) 00010000:00010000:3.0:1782487585.878350:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878351:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.878356:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.878362:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85c4cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878365:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c477 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878398:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1073:294444:x1869066294309760:12345-192.168.202.21@tcp:35:touch.500 Request processed in 329us (3983us total) trans 8589956802 rc 0/0 00010000:00010000:3.0:1782487585.878400:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85c4bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c3a expref: 1073 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.878415:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5750 00000100:00100000:2.0:1782487585.878416:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299290157 time 7213299803376 state 0x0 ref 2 00010000:00010000:3.0:1782487585.878426:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c3a expref: 1072 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.878433:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1071:294452:x1869066294310400:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.878443:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:3.0:1782487585.878448:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.878448:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.878453:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00010000:00010000:2.0:1782487585.878461:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c4d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c41 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.878468:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.878474:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.878483:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1072:294449:x1869066294310272:12345-192.168.202.21@tcp:101:rm.500 Request processed in 668us (897us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487585.878483:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.878488:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878495:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.878496:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26916 00010000:00010000:1.0:1782487585.878496:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878517:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.878517:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb32:0x0].0x0 (ffff9cb543a0db00) 00010000:00010000:1.0:1782487585.878521:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.878525:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.878532:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c4a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878533:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.878548:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.878551:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.878552:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.878556:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.878563:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878572:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878858:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878868:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878876:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.878896:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf5:0x0]: returning size 0 00000004:00200000:2.0:1782487585.878899:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.878911:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878920:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878928:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878934:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878944:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878950:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.878954:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878961:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878971:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.878973:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.878977:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878982:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c4e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.878994:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879000:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879006:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879013:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.879017:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879029:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879038:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb543a0de00) 00010000:00010000:2.0:1782487585.879041:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.879044:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879051:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c4e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879080:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c4d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c41 expref: 1072 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879095:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c41 expref: 1071 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.879103:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487585.879106:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.879109:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac000, rc 0) 00000100:00100000:2.0:1782487585.879143:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1071:294452:x1869066294310400:12345-192.168.202.21@tcp:101:rm.500 Request processed in 715us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.879151:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26917 00000100:00100000:2.0:1782487585.879157:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299290157 time 7213299803376 state 0x2 ref 0 00010000:00010000:3.0:1782487585.881690:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881703:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881711:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881718:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.881723:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881732:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881748:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb543a0d600) 00010000:00010000:3.0:1782487585.881752:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.881756:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.881762:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85c493 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.882428:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.882478:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310656 00000100:00100000:1.0:1782487585.882486:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310656 00000100:00100000:1.0:1782487585.882540:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16164 00000100:00100000:1.0:1782487585.882552:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2360:x1869066294310656:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.882568:0:213220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.882585:0:213220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c4f expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.882630:0:213220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186b:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487585.882648:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.882653:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.882662:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 107 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.882678:0:213220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 107 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.882690:0:213220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd88000, rc 0) 00000100:00100000:1.0:1782487585.882736:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2360:x1869066294310656:12345-192.168.202.21@tcp:101:rm.500 Request processed in 186us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.882746:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16164 00000100:00100000:3.0:1782487585.882894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.883011:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.883056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.883095:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310912 00000100:00100000:2.0:1782487585.883099:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294310528 00000100:00100000:3.0:1782487585.883100:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310912 00000100:00100000:2.0:1782487585.883108:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294310528 00000100:00100000:3.0:1782487585.883129:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299290157 time 7213299803376 state 0x0 ref 1 00000100:00100000:3.0:1782487585.883141:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299903376 time 7213299803376 state 0x1 ref 1 00000100:00100000:2.0:1782487585.883152:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16165 00000100:00100000:2.0:1782487585.883163:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2362:x1869066294310528:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:3.0:1782487585.883165:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294311168 00000100:00100000:3.0:1782487585.883171:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294311168 00010000:00010000:2.0:1782487585.883174:0:213213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.883191:0:213213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c48 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.883193:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213299903376 time 7213299803376 state 0x1 ref 2 00002000:00010000:2.0:1782487585.883231:0:213213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186a:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:3.0:1782487585.883235:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213304723819 time 7213304623819 state 0x1 ref 2 00010000:00010000:2.0:1782487585.883244:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=7213s v=(0 0) 00000100:00100000:3.0:1782487585.883250:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+680:294425:x1869066294310912:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.883251:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.883264:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 108 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.883279:0:213213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 108 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.883291:0:213213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac600, rc 0) 00010000:00010000:3.0:1782487585.883296:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782487585.883317:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c01e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aea expref: 680 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.883326:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2362:x1869066294310528:12345-192.168.202.21@tcp:101:rm.500 Request processed in 162us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.883337:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16165 00010000:00010000:3.0:1782487585.883343:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85c010 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a9d expref: 679 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883427:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85bdfc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a42 expref: 678 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883441:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:3.0:1782487585.883451:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.883469:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883481:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883490:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883505:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883514:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883522:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883673:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883683:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.883692:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.884227:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2527, 64 off169920 00010000:00010000:3.0:1782487585.884320:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884331:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884340:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884348:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884356:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884428:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884448:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.884466:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884474:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884481:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884488:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.884493:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884500:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884512:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.884516:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.884520:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884527:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c511 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884543:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884549:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884560:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884566:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.884570:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884578:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884588:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.884591:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.884594:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884602:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c503 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.884688:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213304723819 time 7213306076689 state 0x0 ref 2 00000100:00100000:1.0:1782487585.884707:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1071:294458:x1869066294311168:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.884719:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.884731:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85c51f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c56 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.884808:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007780a688 reply state 00000000bed2fccc transno 8589956803 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.884816:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.884819:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.884831:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.884841:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.884861:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294425:x1869066294310912:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1613us (1967us total) trans 8589956803 rc 0/0 00010000:00010000:1.0:1782487585.884861:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.884875:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26918 00010000:00010000:1.0:1782487585.884876:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.884887:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884903:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.884910:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884917:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.884922:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884929:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884937:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb36:0x0].0x0 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.884940:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.884943:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884947:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c518 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.884963:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.884966:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.884969:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487585.885314:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186c:0x0], index 0: 0 00010000:00010000:1.0:1782487585.885480:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c534 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885490:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c534 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885499:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c534 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885527:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885534:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885541:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885547:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.885551:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885563:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885574:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.885577:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.885581:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885587:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85c526 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.885600:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acf8f1a2 reply state 0000000086376df4 transno 8589956804 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.885631:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.885656:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85c51f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c56 expref: 1074 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885671:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c534 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c56 expref: 1073 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.885680:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487585.885683:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.885686:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc 0) 00000100:00100000:1.0:1782487585.885717:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1074:294458:x1869066294311168:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1016us (2708us total) trans 8589956804 rc 0/0 00000100:00100000:1.0:1782487585.885725:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26919 00000100:00100000:1.0:1782487585.885730:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213304723819 time 7213306076689 state 0x2 ref 0 00010000:00010000:3.0:1782487585.886861:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886868:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886873:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886878:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.886881:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886885:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886897:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb54c47f600) 00010000:00010000:3.0:1782487585.886900:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.886903:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.886909:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85c52d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887773:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887783:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887791:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887802:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.887806:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887813:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887825:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4c5187900) 00010000:00010000:2.0:1782487585.887828:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.887832:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.887838:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c50a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.892477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.892520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.892559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.892601:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294311424 00000100:00100000:3.0:1782487585.892633:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294311424 00000100:00100000:3.0:1782487585.892676:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213304723819 time 7213306076689 state 0x0 ref 1 00000100:00100000:3.0:1782487585.892689:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213306176689 time 7213306076689 state 0x1 ref 1 00000100:00100000:3.0:1782487585.892715:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294311680 00000100:00100000:3.0:1782487585.892719:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294311680 00000100:00100000:3.0:1782487585.892736:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213306176689 time 7213306076689 state 0x1 ref 2 00000100:00100000:3.0:1782487585.892757:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294311936 00000100:00100000:3.0:1782487585.892761:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294311936 00000100:00100000:3.0:1782487585.892778:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213306176689 time 7213306076689 state 0x1 ref 3 00000100:00100000:3.0:1782487585.892804:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314294455 time 7213314194455 state 0x1 ref 3 00000100:00100000:3.0:1782487585.892820:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294433:x1869066294311424:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:1.0:1782487585.892870:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213314357199 time 7213314257199 state 0x1 ref 3 00010000:00010000:3.0:1782487585.892872:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:1.0:1782487585.892889:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1074:294458:x1869066294311680:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.892902:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85c160 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b06 expref: 678 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.892917:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.892932:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85c072 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477aa4 expref: 677 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.892936:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c534 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c56 expref: 1074 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.892962:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487585.892967:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85beb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a6c expref: 676 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.892974:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.892983:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5d1ac00) 00010000:00010000:3.0:1782487585.892995:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.893015:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893029:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893037:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893040:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893055:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893065:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893067:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893085:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893096:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.893227:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff64b2bd reply state 00000000dd309e82 transno 8589956805 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893236:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.893238:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.893254:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893263:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.893321:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1075:294458:x1869066294311680:12345-192.168.202.21@tcp:36:touch.500 Request processed in 434us (799us total) trans 8589956805 rc 0/0 00000100:00100000:1.0:1782487585.893330:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26921 00000100:00100000:1.0:1782487585.893356:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314357199 time 7213314746486 state 0x0 ref 2 00000100:00100000:1.0:1782487585.893368:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1074:294453:x1869066294311936:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.893380:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.893392:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c55e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c5d expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893654:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893666:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893676:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893692:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893700:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.893709:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.893870:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2535, 64 off170432 00010000:00010000:3.0:1782487585.893977:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893987:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.893996:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894004:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894012:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894019:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894044:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.894050:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.894057:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894059:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894071:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894082:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.894083:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894088:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894093:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.894097:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894099:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894112:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.894113:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894117:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.894121:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894129:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb39:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:2.0:1782487585.894130:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c573 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894137:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.894143:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894144:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.894148:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.894153:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c557 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.894153:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487585.894161:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1846:0x0], index 1: 0 00010000:00010000:3.0:1782487585.894177:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894184:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894191:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894197:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.894200:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894224:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894235:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.894238:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.894242:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.894248:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c542 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.894263:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000720b66ff reply state 0000000088599569 transno 8589956806 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.894270:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.894317:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+677:294433:x1869066294311424:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1500us (1847us total) trans 8589956806 rc 0/0 00000100:00100000:3.0:1782487585.894325:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26920 00010000:00010000:1.0:1782487585.894342:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c57a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894353:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c57a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894362:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c57a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894395:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894403:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894409:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894415:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.894419:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894425:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894437:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.894440:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.894444:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894450:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c565 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.894580:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068f77cb6 reply state 0000000043ac5aa4 transno 8589956807 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.894653:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.894679:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c55e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c5d expref: 1077 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894701:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c57a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c5d expref: 1076 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.894710:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487585.894713:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.894716:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8c000, rc 0) 00000100:00100000:1.0:1782487585.894744:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1077:294453:x1869066294311936:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1378us (2189us total) trans 8589956807 rc 0/0 00000100:00100000:1.0:1782487585.894752:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26922 00000100:00100000:1.0:1782487585.894757:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314357199 time 7213314746486 state 0x2 ref 0 00010000:00010000:2.0:1782487585.896941:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.896950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.896951:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.896959:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.896964:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.896967:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.896972:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.896983:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:2.0:1782487585.896985:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.896988:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.896992:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c549 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897084:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897094:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.897098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.897105:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897111:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.897115:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897121:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897132:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4549e8d00) 00010000:00010000:2.0:1782487585.897135:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.897136:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897139:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897151:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c56c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897219:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897227:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897233:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.897238:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897246:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.897255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.897262:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.897266:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.897271:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897278:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85c550 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.897282:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294312064 00000100:00100000:2.0:1782487585.897288:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294312064 00000100:00100000:2.0:1782487585.897314:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314357199 time 7213314746486 state 0x0 ref 1 00000100:00100000:3.0:1782487585.897318:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294312576 00000100:00100000:3.0:1782487585.897324:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294312576 00000100:00100000:2.0:1782487585.897325:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314846486 time 7213314746486 state 0x1 ref 1 00000100:00100000:2.0:1782487585.897342:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294312448 00000100:00100000:2.0:1782487585.897345:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294312448 00000100:00100000:3.0:1782487585.897349:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314846486 time 7213314746486 state 0x1 ref 2 00000100:00100000:2.0:1782487585.897361:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213314846486 time 7213314746486 state 0x1 ref 3 00000100:00100000:3.0:1782487585.897382:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213318870902 time 7213318770902 state 0x1 ref 3 00000100:00100000:2.0:1782487585.897391:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213318881269 time 7213318781269 state 0x1 ref 3 00000100:00100000:3.0:1782487585.897398:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1077:294458:x1869066294312064:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487585.897404:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1077:294453:x1869066294312576:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.897502:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.897522:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c588 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c64 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897523:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.897540:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c57a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c5d expref: 1077 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.897543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.897554:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487585.897563:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487585.897574:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294312832 00000100:00100000:1.0:1782487585.897579:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294312832 00000100:00100000:1.0:1782487585.897599:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213318881269 time 7213318781269 state 0x1 ref 4 00010000:00010000:2.0:1782487585.897625:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897634:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.897635:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319124550 time 7213319024550 state 0x1 ref 4 00010000:00010000:3.0:1782487585.897642:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c588 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c64 expref: 1077 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.897650:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.897658:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1077:294455:x1869066294312448:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.897662:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c588 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c64 expref: 1077 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.897669:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.897682:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c596 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c6b expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897692:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487585.897696:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.897700:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4683ca600, rc 0) 00000100:00100000:3.0:1782487585.897747:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294458:x1869066294312064:12345-192.168.202.21@tcp:101:touch.500 Request processed in 352us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.897757:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26923 00000004:00010000:2.0:1782487585.897772:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004471ef52 reply state 00000000dc487eb9 transno 8589956808 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.897779:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.897782:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.897787:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319124550 time 7213319175839 state 0x0 ref 3 00010000:00010000:1.0:1782487585.897799:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.897808:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+676:294422:x1869066294312832:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.897814:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.897824:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294453:x1869066294312576:12345-192.168.202.21@tcp:36:touch.500 Request processed in 424us (731us total) trans 8589956808 rc 0/0 00000100:00100000:2.0:1782487585.897831:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26924 00010000:00010000:1.0:1782487585.897831:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897836:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782487585.897842:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.897851:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897855:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85bf8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477adc expref: 676 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897881:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85bfe6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a8f expref: 675 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897900:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85bd62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a1f expref: 674 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897911:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:3.0:1782487585.897921:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.897936:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897945:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897954:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897971:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897979:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.897986:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.898091:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.898100:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.898109:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487585.898346:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186d:0x0], index 0: 0 00010000:00010000:1.0:1782487585.898493:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c5c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898502:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898511:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898536:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898543:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898550:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898561:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.898565:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898573:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898583:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.898586:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.898590:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.898596:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c59d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.898630:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089d08f6b reply state 00000000dc235b17 transno 8589956809 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.899022:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.899048:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c596 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c6b expref: 1080 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.899066:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c6b expref: 1079 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.899074:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487585.899077:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.899081:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00000100:00100000:1.0:1782487585.899113:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294455:x1869066294312448:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1460us (1861us total) trans 8589956809 rc 0/0 00000100:00100000:1.0:1782487585.899123:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26925 00000040:00080000:3.0:1782487585.899721:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2528, 64 off169984 00010000:00010000:3.0:1782487585.899823:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899835:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899844:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899853:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899861:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899867:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899891:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.899904:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899908:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487585.899911:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899915:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899922:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899938:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.899942:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899944:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.899953:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899953:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899963:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.899984:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:3.0:1782487585.899989:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.899994:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.899998:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb34:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:3.0:1782487585.900001:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85c5b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.900002:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.900006:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.900019:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c5ce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.900035:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.900040:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.900045:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.900046:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.900049:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.900057:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.900064:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.900074:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.900082:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.900093:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.900096:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.900100:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.900106:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c5ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.900120:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aecd2933 reply state 00000000a903c5a0 transno 8589956810 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.900128:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.900170:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+675:294422:x1869066294312832:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2367us (2631us total) trans 8589956810 rc 0/0 00000100:00100000:3.0:1782487585.900182:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26926 00000100:00100000:3.0:1782487585.900189:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319124550 time 7213319175839 state 0x2 ref 0 00010000:00010000:3.0:1782487585.901168:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901178:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901186:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901193:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.901197:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901215:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901228:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb543a0de00) 00010000:00010000:3.0:1782487585.901232:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.901236:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901243:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c58f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901248:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901259:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901267:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901275:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.901279:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901291:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901303:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487585.901306:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.901309:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901311:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.901323:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c5a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901326:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901336:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901343:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.901347:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901356:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901368:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487585.901372:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.901375:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.901381:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85c5b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.902055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.902077:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294312960 00000100:00100000:2.0:1782487585.902084:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294312960 00000100:00100000:1.0:1782487585.902104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.902112:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319124550 time 7213319175839 state 0x0 ref 1 00000100:00100000:2.0:1782487585.902125:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319275839 time 7213319175839 state 0x1 ref 1 00000100:00100000:1.0:1782487585.902139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.902154:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294313344 00000100:00100000:2.0:1782487585.902159:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294313344 00000100:00100000:1.0:1782487585.902182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.902222:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294313600 00000100:00100000:1.0:1782487585.902227:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294313600 00000100:00100000:3.0:1782487585.902262:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213319275839 time 7213323563280 state 0x0 ref 1 00000100:00100000:2.0:1782487585.902276:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323663280 time 7213323563280 state 0x1 ref 3 00000100:00100000:3.0:1782487585.902282:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294453:x1869066294312960:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:1.0:1782487585.902289:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323663280 time 7213323563280 state 0x1 ref 3 00010000:00010000:3.0:1782487585.902301:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.902302:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323792010 time 7213323692010 state 0x1 ref 3 00000100:00100000:2.0:1782487585.902318:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294455:x1869066294313344:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487585.902320:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213323792010 time 7213323708883 state 0x0 ref 3 00010000:00010000:3.0:1782487585.902321:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c5d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c72 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.902342:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+674:294418:x1869066294313600:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.902355:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.902371:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.902373:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c5c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c6b expref: 1080 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.902388:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487585.902389:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c113 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af8 expref: 674 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.902401:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.902409:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c72 expref: 1079 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902417:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85bbb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779a1 expref: 673 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902444:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487585.902447:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c72 expref: 1079 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.902453:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902455:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.902465:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.902468:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.902471:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.902477:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.902480:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.902482:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5735d7000, rc 0) 00010000:00010000:1.0:1782487585.902488:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902501:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902518:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.902529:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294453:x1869066294312960:12345-192.168.202.21@tcp:101:touch.500 Request processed in 251us (477us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487585.902546:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.902547:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26927 00010000:00010000:1.0:1782487585.902559:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.902603:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060c9711e reply state 000000005e9aadf5 transno 8589956811 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.902689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.902774:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294313856 00000100:00100000:3.0:1782487585.902779:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294313856 00010000:00010000:1.0:1782487585.902799:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902809:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.902817:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.902846:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213323808883 time 7213323708883 state 0x1 ref 3 00000100:00100000:3.0:1782487585.902871:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323808883 time 7213324262139 state 0x0 ref 3 00000100:00100000:3.0:1782487585.902897:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294452:x1869066294313856:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.902920:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.902939:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c4ee lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c41 expref: 1080 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.902961:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c33c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bfb expref: 1079 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.902976:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:3.0:1782487585.902988:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.903001:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903011:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903019:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903036:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903044:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.903046:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903056:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903113:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1079:294455:x1869066294313344:12345-192.168.202.21@tcp:36:touch.500 Request processed in 798us (973us total) trans 8589956811 rc 0/0 00000100:00100000:2.0:1782487585.903122:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26928 00010000:00010000:3.0:1782487585.903145:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903153:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294313088 00010000:00010000:3.0:1782487585.903155:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903158:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294313088 00010000:00010000:3.0:1782487585.903167:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903200:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16166 00000100:00100000:2.0:1782487585.903220:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2361:x1869066294313088:12345-192.168.202.21@tcp:2:touch.500 00000040:00080000:1.0:1782487585.903348:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2529, 64 off170048 00010000:00010000:1.0:1782487585.903449:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903459:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903469:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903477:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903483:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2361:x1869066294313088:12345-192.168.202.21@tcp:2:touch.500 Request processed in 263us (1378us total) trans 8589940659 rc 0/0 00010000:00010000:1.0:1782487585.903489:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.903497:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16166 00010000:00010000:1.0:1782487585.903500:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903518:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.903534:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.903540:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903550:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.903554:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903562:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903574:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.903577:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.903582:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903588:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c60d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903603:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.903628:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.903632:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782487585.903681:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2536, 64 off170496 00010000:00010000:1.0:1782487585.903723:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903731:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903743:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903750:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.903755:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903756:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903768:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903773:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903780:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb30:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.903786:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.903791:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903793:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903804:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c5f1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903826:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903833:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903840:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903846:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.903850:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903860:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903869:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.903872:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.903876:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.903882:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c5e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.903893:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b1bb325 reply state 00000000273ca36d transno 8589956812 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903896:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.903904:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.903912:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903919:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903936:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.903951:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487585.903954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.903954:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+674:294418:x1869066294313600:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1612us (1769us total) trans 8589956812 rc 0/0 00010000:00010000:3.0:1782487585.903957:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903970:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487585.903974:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26929 00010000:00010000:3.0:1782487585.903976:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903986:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.903998:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.904001:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1782487585.904004:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294313984 00010000:00010000:3.0:1782487585.904005:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.904010:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294313984 00010000:00010000:3.0:1782487585.904017:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c614 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904034:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.904037:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.904041:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487585.904048:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16167 00000100:00100000:1.0:1782487585.904057:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2363:x1869066294313984:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487585.904061:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904070:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904076:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904082:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.904086:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904093:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904103:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf5:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.904106:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.904110:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904116:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c606 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904136:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904143:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904150:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904156:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.904159:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904167:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904177:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.904180:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.904184:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.904190:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85c5f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.904201:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad237b6f reply state 000000002853b2b6 transno 8589956813 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.904221:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.904254:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2363:x1869066294313984:12345-192.168.202.21@tcp:2:touch.500 Request processed in 197us (307us total) trans 8589939998 rc 0/0 00000100:00100000:1.0:1782487585.904263:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16167 00000100:00100000:3.0:1782487585.904278:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294452:x1869066294313856:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1395us (1590us total) trans 8589956813 rc 0/0 00000100:00100000:3.0:1782487585.904288:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26930 00000100:00100000:3.0:1782487585.904294:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323808883 time 7213324262139 state 0x2 ref 0 00010000:00010000:3.0:1782487585.906135:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906151:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906158:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906164:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715aca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.906169:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906176:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906189:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:3.0:1782487585.906192:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.906197:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906216:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715aca00/0x66475b4e8b85c5dc lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.906238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.906271:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294314112 00000100:00100000:2.0:1782487585.906276:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294314112 00000100:00100000:2.0:1782487585.906301:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213323808883 time 7213324262139 state 0x0 ref 1 00000100:00100000:2.0:1782487585.906312:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213324362139 time 7213324262139 state 0x1 ref 1 00000100:00100000:2.0:1782487585.906351:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213324362139 time 7213327740811 state 0x0 ref 1 00000100:00100000:2.0:1782487585.906363:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294455:x1869066294314112:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.906377:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.906393:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c61b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c79 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.906436:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c61b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c79 expref: 1081 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.906450:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c61b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c79 expref: 1081 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.906468:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:2.0:1782487585.906471:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.906475:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196ce00, rc 0) 00000100:00100000:2.0:1782487585.906517:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56f9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294455:x1869066294314112:12345-192.168.202.21@tcp:101:touch.500 Request processed in 155us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.906527:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26931 00000100:00100000:2.0:1782487585.906533:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213324362139 time 7213327740811 state 0x2 ref 0 00000100:00100000:3.0:1782487585.906686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.906688:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906703:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906710:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906716:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.906717:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906721:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906735:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906738:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906754:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906760:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4c9e2f000) 00010000:00010000:1.0:1782487585.906767:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.906772:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906774:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.906780:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.906783:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c5ea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906800:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906815:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c5187c00) 00010000:00010000:3.0:1782487585.906818:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.906822:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.906829:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85c5ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.907081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.908116:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294314624 00000100:00100000:2.0:1782487585.908122:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294314624 00000100:00100000:2.0:1782487585.908142:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213324362139 time 7213327740811 state 0x0 ref 1 00000100:00100000:2.0:1782487585.908152:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213327840811 time 7213327740811 state 0x1 ref 1 00000100:00100000:2.0:1782487585.908181:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213327840811 time 7213329571120 state 0x0 ref 1 00000100:00100000:2.0:1782487585.908194:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+673:294420:x1869066294314624:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.908245:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.908265:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c208 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ad5 expref: 673 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908287:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85bd31 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a11 expref: 672 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908300:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:2.0:1782487585.908312:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.908329:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908341:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908350:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908363:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908370:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908377:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.908392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.908441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.908496:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908506:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.908515:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.908646:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294314368 00000100:00100000:2.0:1782487585.908651:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294314368 00000100:00100000:2.0:1782487585.908685:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294315136 00000100:00100000:2.0:1782487585.908689:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294315136 00000100:00100000:2.0:1782487585.908714:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5751 00000100:00100000:2.0:1782487585.908724:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5482f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294458:x1869066294314368:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.908985:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5482f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294458:x1869066294314368:12345-192.168.202.21@tcp:35:touch.500 Request processed in 262us (2300us total) trans 8589956814 rc 0/0 00000100:00100000:2.0:1782487585.908994:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5751 00000100:00100000:2.0:1782487585.909045:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5752 00000100:00100000:2.0:1782487585.909056:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1080:294453:x1869066294315136:12345-192.168.202.21@tcp:35:touch.500 00000040:00080000:3.0:1782487585.909058:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2537, 64 off170560 00010000:00010000:3.0:1782487585.909141:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909151:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909157:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909164:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909172:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909176:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.909197:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294453:x1869066294315136:12345-192.168.202.21@tcp:35:touch.500 Request processed in 144us (755us total) trans 8589956816 rc 0/0 00000100:00100000:2.0:1782487585.909243:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5752 00010000:00010000:3.0:1782487585.909258:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.909272:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.909279:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.909291:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.909296:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.909303:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.909312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.909319:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487585.909323:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1782487585.909326:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294314880 00010000:00010000:2.0:1782487585.909327:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.909333:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294314880 00010000:00010000:2.0:1782487585.909338:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c637 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.909355:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487585.909359:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213329671120 time 7213329571120 state 0x1 ref 2 00010000:00010000:2.0:1782487585.909360:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.909364:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487585.909378:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294315264 00000100:00100000:2.0:1782487585.909382:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294315264 00000100:00100000:1.0:1782487585.909386:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213329671120 time 7213330775512 state 0x0 ref 2 00000100:00100000:1.0:1782487585.909400:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294449:x1869066294314880:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:2.0:1782487585.909415:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16168 00010000:00010000:3.0:1782487585.909417:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909423:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.909425:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.909425:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2361:x1869066294315264:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487585.909436:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909443:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c4d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c3a expref: 1081 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909467:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c2e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bdf expref: 1080 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909479:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:3.0:1782487585.909484:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.909491:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.909492:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909502:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909504:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909520:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb33:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487585.909521:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909526:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.909531:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909536:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909537:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c630 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909563:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909572:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909573:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909589:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909590:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.909602:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2361:x1869066294315264:12345-192.168.202.21@tcp:2:touch.500 Request processed in 178us (294us total) trans 8589940660 rc 0/0 00010000:00010000:3.0:1782487585.909624:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.909635:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16168 00010000:00010000:3.0:1782487585.909640:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.909645:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909653:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909663:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.909666:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.909670:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.909678:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85c622 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.909691:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e19404 reply state 00000000bad39c54 transno 8589956815 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909694:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.909705:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.909710:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.909725:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.909851:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+673:294420:x1869066294314624:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1614us (2726us total) trans 8589956815 rc 0/0 00000100:00100000:3.0:1782487585.909862:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26932 00000040:00080000:1.0:1782487585.910084:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2538, 64 off170624 00010000:00010000:1.0:1782487585.910145:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910155:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910164:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910172:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910179:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910185:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910213:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.910224:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.910226:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.910233:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910235:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910253:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.910254:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.910260:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.910278:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910278:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.910285:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.910290:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487585.910294:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.910296:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910299:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.910301:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c653 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910320:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf3:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487585.910321:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.910326:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.910326:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.910331:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.910333:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910341:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c64c lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910360:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910366:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910372:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910378:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.910382:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910389:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910402:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.910405:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.910408:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.910414:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c63e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.910425:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed970cb9 reply state 00000000273ca36d transno 8589956817 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.910432:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.910478:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294449:x1869066294314880:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1080us (2085us total) trans 8589956817 rc 0/0 00000100:00100000:1.0:1782487585.910486:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26933 00000100:00100000:1.0:1782487585.910492:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213329671120 time 7213330775512 state 0x2 ref 0 00000100:00100000:3.0:1782487585.913819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.913830:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.913842:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.913850:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.913857:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:2.0:1782487585.913861:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294315520 00010000:00010000:1.0:1782487585.913863:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.913869:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294315520 00000100:00100000:3.0:1782487585.913875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.913884:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.913900:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb543a0d700) 00010000:00010000:1.0:1782487585.913904:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.913909:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.913913:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294315776 00010000:00010000:1.0:1782487585.913917:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c629 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.913921:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5753 00000100:00100000:2.0:1782487585.913938:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294455:x1869066294315520:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.913960:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294315776 00000100:00100000:3.0:1782487585.913991:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213329671120 time 7213330775512 state 0x0 ref 1 00000100:00100000:3.0:1782487585.914001:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213330875512 time 7213330775512 state 0x1 ref 1 00000100:00100000:3.0:1782487585.914023:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213330875512 time 7213335413084 state 0x0 ref 1 00000100:00100000:3.0:1782487585.914036:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+672:294415:x1869066294315776:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.914068:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.914087:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c06b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477af1 expref: 672 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914107:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ba8a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47794d expref: 671 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914120:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4ba768900) 00010000:00010000:3.0:1782487585.914128:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.914143:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914153:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914160:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914170:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914175:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914180:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914285:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914291:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914296:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.914412:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1082:294455:x1869066294315520:12345-192.168.202.21@tcp:35:touch.500 Request processed in 477us (595us total) trans 8589956818 rc 0/0 00000100:00100000:2.0:1782487585.914421:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5753 00010000:00010000:3.0:1782487585.914555:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914564:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914571:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914802:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.914805:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914817:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914829:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4c9e2f900) 00010000:00010000:3.0:1782487585.914833:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.914836:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.914843:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c645 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.915038:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2530, 64 off170112 00010000:00010000:2.0:1782487585.915106:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915122:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915132:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915140:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915147:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915153:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915201:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.915211:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.915219:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.915227:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.915229:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915237:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915245:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.915245:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915260:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715ac000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.915263:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915266:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915281:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.915281:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:1.0:1782487585.915288:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.915293:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915303:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb2e:0x0].0x0 (ffff9cb4c5187500) 00010000:00010000:2.0:1782487585.915310:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.915314:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c66f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915316:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915332:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715ac000/0x66475b4e8b85c668 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.915338:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.915343:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.915346:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.915354:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915362:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915368:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915374:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.915378:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915384:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915393:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.915396:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.915399:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.915406:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c65a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.915421:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e5defd4 reply state 000000002853b2b6 transno 8589956819 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.915429:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.915477:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+672:294415:x1869066294315776:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1443us (1603us total) trans 8589956819 rc 0/0 00000100:00100000:2.0:1782487585.915486:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26934 00000100:00100000:2.0:1782487585.915492:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213330875512 time 7213335413084 state 0x2 ref 0 00000100:00100000:3.0:1782487585.916041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.916092:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294316032 00000100:00100000:2.0:1782487585.916099:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294316032 00010000:00010000:1.0:1782487585.916115:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.916122:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213330875512 time 7213335413084 state 0x0 ref 1 00010000:00010000:1.0:1782487585.916127:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.916138:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213335513084 time 7213335413084 state 0x1 ref 1 00010000:00010000:1.0:1782487585.916138:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.916153:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.916157:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.916165:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.916176:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb4c5187c00) 00010000:00010000:1.0:1782487585.916180:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.916183:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.916185:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213335513084 time 7213337574235 state 0x0 ref 1 00010000:00010000:1.0:1782487585.916199:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c661 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.916218:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1081:294463:x1869066294316032:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.916233:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.916247:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c676 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c80 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916357:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916370:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916380:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916395:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916403:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.916411:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487585.916870:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1847:0x0], index 1: 0 00010000:00010000:2.0:1782487585.917026:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c68b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917036:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c68b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917045:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c68b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917075:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917082:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917089:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917096:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.917100:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917111:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917122:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.917126:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.917130:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917137:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c67d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.917150:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e728689f reply state 000000003356b78a transno 8589956820 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.917158:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.917183:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85c676 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c80 expref: 1084 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917197:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c68b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c80 expref: 1083 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917215:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:2.0:1782487585.917218:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.917221:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d9000, rc 0) 00000100:00100000:2.0:1782487585.917273:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1084:294463:x1869066294316032:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1068us (1244us total) trans 8589956820 rc 0/0 00000100:00100000:2.0:1782487585.917281:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26935 00000100:00100000:2.0:1782487585.917285:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213335513084 time 7213337574235 state 0x2 ref 0 00000100:00100000:3.0:1782487585.917559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.917600:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294316288 00000100:00100000:2.0:1782487585.917627:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294316288 00000100:00100000:2.0:1782487585.917647:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213335513084 time 7213337574235 state 0x0 ref 1 00000100:00100000:2.0:1782487585.917656:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213337674235 time 7213337574235 state 0x1 ref 1 00000100:00100000:2.0:1782487585.917687:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213337674235 time 7213339076882 state 0x0 ref 1 00000100:00100000:2.0:1782487585.917748:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+671:294431:x1869066294316288:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.917772:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.917786:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85c17c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b0d expref: 671 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917802:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85be81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477a65 expref: 670 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917813:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487585.917823:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.917837:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917847:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917856:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917868:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917877:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917882:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917950:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917958:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.917966:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.917991:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918001:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918008:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918015:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.918019:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918027:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918038:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb543a0de00) 00010000:00010000:1.0:1782487585.918042:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.918045:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.918051:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c684 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.918348:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2531, 64 off170176 00010000:00010000:2.0:1782487585.918416:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918424:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918430:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918436:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918440:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918444:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918460:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.918471:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918478:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918485:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918491:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.918492:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.918496:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918500:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918505:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918523:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487585.918527:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.918531:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918532:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487585.918540:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918542:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c6a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918559:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918568:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918574:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb38:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487585.918576:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918579:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.918586:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918594:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918599:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85c6ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918603:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a2c13800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.918628:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918637:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.918642:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.918646:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.918648:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.918650:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.918654:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.918658:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.918665:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c699 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.918679:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b24604fc reply state 00000000dc487eb9 transno 8589956821 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.918686:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.918746:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+671:294431:x1869066294316288:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1048us (1188us total) trans 8589956821 rc 0/0 00000100:00100000:2.0:1782487585.918753:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26936 00000100:00100000:2.0:1782487585.918758:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213337674235 time 7213339076882 state 0x2 ref 0 00010000:00010000:1.0:1782487585.919426:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919437:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919444:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919451:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.919455:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919463:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919479:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487585.919483:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.919487:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.919493:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019b400/0x66475b4e8b85c6a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.919769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.919832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.919850:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294316544 00000100:00100000:1.0:1782487585.919856:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294316544 00000100:00100000:2.0:1782487585.919868:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294316800 00000100:00100000:2.0:1782487585.919873:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294316800 00000100:00100000:1.0:1782487585.919882:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213337674235 time 7213339076882 state 0x0 ref 1 00000100:00100000:2.0:1782487585.919892:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213339176882 time 7213339076882 state 0x1 ref 2 00000100:00100000:1.0:1782487585.919902:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213339176882 time 7213339076882 state 0x1 ref 2 00000100:00100000:2.0:1782487585.919914:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213341404258 time 7213341304258 state 0x1 ref 2 00000100:00100000:2.0:1782487585.919922:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1084:294464:x1869066294316800:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.919933:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.919940:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213341404258 time 7213341328662 state 0x0 ref 2 00010000:00010000:2.0:1782487585.919943:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85c6b5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c87 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.919970:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1085:294463:x1869066294316544:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487585.920009:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.920027:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85c68b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c80 expref: 1085 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920039:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920051:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920060:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920075:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.920082:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:2.0:1782487585.920084:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920095:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.920097:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.920155:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.920165:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.920187:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.920304:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017a8c417 reply state 0000000097eadb20 transno 8589956822 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.920313:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.920392:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1086:294463:x1869066294316544:12345-192.168.202.21@tcp:36:touch.500 Request processed in 436us (625us total) trans 8589956822 rc 0/0 00000100:00100000:3.0:1782487585.920401:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26938 00000004:00080000:2.0:1782487585.920493:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186e:0x0], index 0: 0 00010000:00010000:2.0:1782487585.920693:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c6d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920703:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920712:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920737:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920742:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920747:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920751:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.920753:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920758:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920765:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.920767:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.920770:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920777:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85c6bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.920789:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a1333fa reply state 000000005e9aadf5 transno 8589956823 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.920796:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.920817:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85c6b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c87 expref: 1087 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920832:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c87 expref: 1086 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.920837:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:2.0:1782487585.920839:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.920841:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498600, rc 0) 00000100:00100000:2.0:1782487585.920871:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1087:294464:x1869066294316800:12345-192.168.202.21@tcp:101:touch.500 Request processed in 950us (1042us total) trans 8589956823 rc 0/0 00000100:00100000:2.0:1782487585.920877:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26937 00000100:00100000:2.0:1782487585.920881:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213341404258 time 7213341328662 state 0x2 ref 0 00010000:00010000:1.0:1782487585.921451:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921460:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921468:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.921472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.921479:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.921484:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921492:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921505:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:1.0:1782487585.921509:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.921513:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.921515:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294316928 00000100:00100000:2.0:1782487585.921522:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294316928 00010000:00010000:1.0:1782487585.921522:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c6ca lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.921543:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213341404258 time 7213341328662 state 0x0 ref 1 00000100:00100000:2.0:1782487585.921553:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213341428662 time 7213341328662 state 0x1 ref 1 00000100:00100000:1.0:1782487585.921587:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213341428662 time 7213342976222 state 0x0 ref 1 00000100:00100000:1.0:1782487585.921603:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1086:294463:x1869066294316928:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.921636:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.921648:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c6df lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c8e expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921676:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c6df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c8e expref: 1087 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921699:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c6df lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c8e expref: 1087 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921718:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487585.921721:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.921724:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4ce00, rc 0) 00000100:00100000:1.0:1782487585.921772:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1087:294463:x1869066294316928:12345-192.168.202.21@tcp:101:touch.500 Request processed in 163us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.921781:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26939 00000100:00100000:1.0:1782487585.921787:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213341428662 time 7213342976222 state 0x2 ref 0 00010000:00010000:1.0:1782487585.921826:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921835:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921842:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921847:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.921851:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921859:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921871:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.921874:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.921878:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.921883:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c6c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.922864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.922892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.922911:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317056 00000100:00100000:2.0:1782487585.922916:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317056 00000100:00100000:1.0:1782487585.922929:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317312 00000100:00100000:2.0:1782487585.922932:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213341428662 time 7213342976222 state 0x0 ref 1 00000100:00100000:1.0:1782487585.922935:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317312 00000100:00100000:2.0:1782487585.922940:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213343076222 time 7213342976222 state 0x1 ref 1 00000100:00100000:1.0:1782487585.922959:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213343076222 time 7213342976222 state 0x1 ref 2 00000100:00100000:2.0:1782487585.922968:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213344458534 time 7213344358534 state 0x1 ref 2 00000100:00100000:2.0:1782487585.922978:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1087:294461:x1869066294317056:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487585.922986:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344458534 time 7213344375009 state 0x0 ref 2 00010000:00010000:2.0:1782487585.922988:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.922998:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c6e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c95 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.923004:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1087:294464:x1869066294317312:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.923045:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.923050:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923063:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c6d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c87 expref: 1088 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923069:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923079:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923080:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb54c47f600) 00010000:00010000:1.0:1782487585.923093:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.923095:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923103:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923110:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923139:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923150:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923159:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.923198:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923216:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923222:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.923242:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf6:0x0]: returning size 0 00000004:00200000:2.0:1782487585.923245:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.923256:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923263:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923269:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.923269:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068f77cb6 reply state 00000000ad06f076 transno 8589956824 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.923283:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.923285:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.923291:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923296:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54151a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.923298:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923311:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923325:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:3.0:1782487585.923326:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317440 00010000:00010000:2.0:1782487585.923329:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782487585.923332:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317440 00010000:00010000:2.0:1782487585.923335:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923343:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c6ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923353:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344475009 time 7213344375009 state 0x1 ref 3 00000100:00100000:1.0:1782487585.923353:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1090:294464:x1869066294317312:12345-192.168.202.21@tcp:36:touch.500 Request processed in 355us (460us total) trans 8589956824 rc 0/0 00010000:00010000:2.0:1782487585.923357:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.923363:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26941 00000100:00100000:3.0:1782487585.923372:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317568 00010000:00010000:2.0:1782487585.923374:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923377:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317568 00010000:00010000:2.0:1782487585.923383:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923387:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.923390:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923395:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344475009 time 7213344375009 state 0x1 ref 3 00010000:00010000:2.0:1782487585.923396:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923413:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c5d1a800) 00010000:00010000:2.0:1782487585.923415:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.923417:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923419:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213344908796 time 7213344808796 state 0x1 ref 3 00010000:00010000:2.0:1782487585.923426:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c6f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.923436:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1090:294474:x1869066294317440:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487585.923442:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344908796 time 7213344833084 state 0x0 ref 3 00010000:00010000:3.0:1782487585.923445:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.923454:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c6e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c95 expref: 1091 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.923456:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1091:294476:x1869066294317568:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.923465:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c709 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477c9c expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923469:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.923478:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c95 expref: 1090 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923479:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c710 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ca3 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.923498:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487585.923502:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.923505:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71600, rc 0) 00010000:00010000:1.0:1782487585.923526:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923536:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923542:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923545:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.923550:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1092:294461:x1869066294317056:12345-192.168.202.21@tcp:101:rm.500 Request processed in 570us (684us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.923554:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923559:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.923565:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26940 00010000:00010000:3.0:1782487585.923567:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923571:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923581:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923586:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923592:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923598:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923674:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923677:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923683:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923686:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923694:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923704:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.923713:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf8:0x0]: returning size 0 00000004:00200000:3.0:1782487585.923716:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00200000:1.0:1782487585.923719:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf9:0x0]: returning size 0 00000004:00200000:1.0:1782487585.923721:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.923727:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.923730:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923736:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923738:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923744:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923750:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923761:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923769:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923775:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923781:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.923781:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923785:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923787:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.923791:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923792:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923798:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923802:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.923805:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.923808:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923813:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.923814:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c71e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923816:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.923819:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923825:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c717 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923826:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923832:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923837:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923838:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923844:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923845:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.923849:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923850:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923858:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.923860:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923861:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923868:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923871:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4c5187500) 00010000:00010000:3.0:1782487585.923874:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.923877:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923877:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.923880:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.923883:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c72c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923883:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923890:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c725 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923914:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c710 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ca3 expref: 1093 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923918:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c709 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c9c expref: 1093 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923928:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ca3 expref: 1091 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.923932:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c9c expref: 1091 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.923935:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:1.0:1782487585.923938:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.923939:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.923941:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c600, rc 0) 00010000:00010000:3.0:1782487585.923942:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.923944:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e600, rc 0) 00000100:00100000:1.0:1782487585.923963:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1091:294476:x1869066294317568:12345-192.168.202.21@tcp:101:rm.500 Request processed in 512us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.923965:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1091:294474:x1869066294317440:12345-192.168.202.21@tcp:101:rm.500 Request processed in 533us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.923971:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26943 00000100:00100000:3.0:1782487585.923976:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26942 00000100:00100000:3.0:1782487585.923988:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344908796 time 7213344833084 state 0x2 ref 0 00000100:00100000:3.0:1782487585.925579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.925870:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317696 00000100:00100000:2.0:1782487585.925877:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317696 00000100:00100000:2.0:1782487585.925929:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16169 00000100:00100000:2.0:1782487585.925940:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57651b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2362:x1869066294317696:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487585.926138:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.926164:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57651b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2362:x1869066294317696:12345-192.168.202.21@tcp:2:touch.500 Request processed in 226us (588us total) trans 8589939999 rc 0/0 00000100:00100000:2.0:1782487585.926171:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16169 00010000:00010000:3.0:1782487585.926190:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.926199:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.926216:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.926220:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.926228:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.926243:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb4c9e2f000) 00010000:00010000:3.0:1782487585.926246:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.926250:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.926257:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c6fb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.926805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.926892:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317824 00000100:00100000:3.0:1782487585.926897:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317824 00000100:00100000:1.0:1782487585.926911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.926917:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344908796 time 7213344833084 state 0x0 ref 1 00000100:00100000:3.0:1782487585.926928:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213344933084 time 7213344833084 state 0x1 ref 1 00000100:00100000:3.0:1782487585.926952:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213344933084 time 7213348341351 state 0x0 ref 1 00000100:00100000:3.0:1782487585.926963:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1089:294464:x1869066294317824:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.926978:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.927017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.927064:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294317952 00000100:00100000:2.0:1782487585.927069:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294317952 00000100:00100000:2.0:1782487585.927133:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16170 00000100:00100000:2.0:1782487585.927143:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2361:x1869066294317952:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.927151:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.927167:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cb1 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.927187:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c748 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477caa expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487585.927188:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1845:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.927215:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.927220:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.927229:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 88 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.927236:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c748 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477caa expref: 1090 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.927249:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c748 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477caa expref: 1090 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.927250:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 88 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.927261:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70000, rc 0) 00010000:00010000:3.0:1782487585.927265:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487585.927268:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487585.927271:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715acc00, rc 0) 00000100:00100000:2.0:1782487585.927292:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+88:2361:x1869066294317952:12345-192.168.202.21@tcp:101:rm.500 Request processed in 151us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.927300:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16170 00000100:00100000:3.0:1782487585.927301:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1090:294464:x1869066294317824:12345-192.168.202.21@tcp:101:touch.500 Request processed in 340us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.927309:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26944 00000100:00100000:3.0:1782487585.927313:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213344933084 time 7213348341351 state 0x2 ref 0 00000100:00100000:1.0:1782487585.927375:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.927402:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294318336 00000100:00100000:3.0:1782487585.927406:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294318336 00000100:00100000:3.0:1782487585.927437:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16171 00000100:00100000:3.0:1782487585.927445:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+88:2361:x1869066294318336:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.927453:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.927483:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294318208 00000100:00100000:2.0:1782487585.927488:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294318208 00000100:00100000:2.0:1782487585.927555:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5754 00010000:00010000:3.0:1782487585.927562:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cb8 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.927564:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1090:294463:x1869066294318208:12345-192.168.202.21@tcp:35:touch.500 00002000:00010000:3.0:1782487585.927578:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1846:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.927589:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.927592:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.927599:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 89 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.927646:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 89 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.927656:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715ac000, rc 0) 00000100:00100000:3.0:1782487585.927685:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2361:x1869066294318336:12345-192.168.202.21@tcp:101:rm.500 Request processed in 242us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.927693:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16171 00000100:00100000:2.0:1782487585.927833:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1091:294463:x1869066294318208:12345-192.168.202.21@tcp:35:touch.500 Request processed in 269us (815us total) trans 8589956825 rc 0/0 00000100:00100000:2.0:1782487585.927841:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5754 00000100:00100000:1.0:1782487585.927937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.927993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.928030:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294318720 00000100:00100000:3.0:1782487585.928034:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294318720 00000100:00100000:3.0:1782487585.928067:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16172 00000100:00100000:3.0:1782487585.928076:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066294318720:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.928084:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.928136:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cc6 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.928154:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186d:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:2.0:1782487585.928156:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294318592 00000100:00100000:2.0:1782487585.928161:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294318592 00010000:00010000:3.0:1782487585.928165:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.928169:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.928176:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 111 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.928176:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213344933084 time 7213348341351 state 0x0 ref 1 00000100:00100000:2.0:1782487585.928185:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213348441351 time 7213348341351 state 0x1 ref 1 00010000:00010000:3.0:1782487585.928196:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 111 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.928217:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715aca00, rc 0) 00000100:00100000:2.0:1782487585.928218:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213348441351 time 7213349608897 state 0x0 ref 1 00000100:00100000:2.0:1782487585.928229:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1091:294465:x1869066294318592:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.928238:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.928249:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c75d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cbf expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.928253:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2360:x1869066294318720:12345-192.168.202.21@tcp:101:rm.500 Request processed in 178us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.928261:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16172 00010000:00010000:2.0:1782487585.928348:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.928357:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.928364:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.928374:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.928379:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.928384:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.928873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.928911:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294318848 00000100:00100000:3.0:1782487585.928917:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294318848 00000100:00100000:3.0:1782487585.928967:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16173 00000100:00100000:3.0:1782487585.928976:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2363:x1869066294318848:12345-192.168.202.21@tcp:2:touch.500 00000004:00080000:2.0:1782487585.929026:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1848:0x0], index 1: 0 00010000:00010000:2.0:1782487585.929182:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c772 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929192:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929200:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929249:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929257:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929264:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929270:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.929275:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929282:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.929284:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2363:x1869066294318848:12345-192.168.202.21@tcp:2:touch.500 Request processed in 309us (412us total) trans 8589940661 rc 0/0 00000100:00100000:3.0:1782487585.929293:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16173 00010000:00010000:2.0:1782487585.929295:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.929298:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.929302:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929308:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c764 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.929322:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b88e8c3a reply state 00000000e2cc3760 transno 8589956826 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.929330:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.929351:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c75d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cbf expref: 1094 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929362:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cbf expref: 1093 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.929371:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.929373:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.929375:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71000, rc 0) 00000100:00100000:2.0:1782487585.929398:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1094:294465:x1869066294318592:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1172us (1408us total) trans 8589956826 rc 0/0 00000100:00100000:2.0:1782487585.929404:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26945 00000100:00100000:2.0:1782487585.929408:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213348441351 time 7213349608897 state 0x2 ref 0 00010000:00010000:2.0:1782487585.931309:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931321:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.931322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.931332:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931338:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.931343:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931349:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931361:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c5d1a800) 00010000:00010000:2.0:1782487585.931365:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.931367:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931376:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c76b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.931552:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294319104 00000100:00100000:3.0:1782487585.931558:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294319104 00000100:00100000:1.0:1782487585.931569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.931632:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5755 00000100:00100000:2.0:1782487585.931635:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294319488 00000100:00100000:2.0:1782487585.931641:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294319488 00000100:00100000:3.0:1782487585.931645:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1093:294464:x1869066294319104:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.931654:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.931667:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213348441351 time 7213349608897 state 0x0 ref 1 00000100:00100000:2.0:1782487585.931678:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213349708897 time 7213349608897 state 0x1 ref 1 00000100:00100000:1.0:1782487585.931679:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294319616 00000100:00100000:1.0:1782487585.931685:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294319616 00000100:00100000:1.0:1782487585.931703:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213349708897 time 7213349608897 state 0x1 ref 2 00000100:00100000:2.0:1782487585.931721:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213353209857 time 7213353109857 state 0x1 ref 2 00000100:00100000:1.0:1782487585.931730:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353209857 time 7213353119927 state 0x0 ref 2 00000100:00100000:2.0:1782487585.931738:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1095:294465:x1869066294319488:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487585.931746:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1095:294466:x1869066294319616:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.931757:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.931768:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.931769:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c780 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ccd expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931787:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c772 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cbf expref: 1097 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931798:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.931805:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.931857:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.931862:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931867:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.931876:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.931880:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.931888:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.931904:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.931915:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.931919:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1096:294464:x1869066294319104:12345-192.168.202.21@tcp:35:touch.500 Request processed in 276us (597us total) trans 8589956827 rc 0/0 00010000:00010000:1.0:1782487585.931927:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.931933:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5755 00000004:00010000:2.0:1782487585.931976:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e88219d reply state 00000000a8a1098c transno 8589956828 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.931989:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.932032:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1097:294465:x1869066294319488:12345-192.168.202.21@tcp:36:touch.500 Request processed in 301us (464us total) trans 8589956828 rc 0/0 00000100:00100000:2.0:1782487585.932038:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26946 00000004:00080000:1.0:1782487585.932310:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186f:0x0], index 0: 0 00010000:00010000:1.0:1782487585.932408:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c79c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932418:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c79c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932426:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c79c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932447:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932454:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932460:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932466:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.932469:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932475:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932487:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.932489:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.932492:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932498:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c78e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.932508:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efbdfc86 reply state 00000000c8a149e1 transno 8589956829 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.932516:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.932532:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c780 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ccd expref: 1098 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932544:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c79c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ccd expref: 1097 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.932551:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487585.932553:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.932556:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558d86800, rc 0) 00000100:00100000:1.0:1782487585.932590:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1098:294466:x1869066294319616:12345-192.168.202.21@tcp:101:touch.500 Request processed in 848us (938us total) trans 8589956829 rc 0/0 00000100:00100000:1.0:1782487585.932596:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26947 00000100:00100000:1.0:1782487585.932601:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353209857 time 7213353119927 state 0x2 ref 0 00010000:00010000:3.0:1782487585.933343:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933358:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933365:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933372:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.933377:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933384:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933396:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:3.0:1782487585.933400:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.933404:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.933411:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c787 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933551:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933565:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933571:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933576:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.933579:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933586:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933594:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.933597:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.933600:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.933622:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c795 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.936500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.936531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.936555:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294319744 00000100:00100000:2.0:1782487585.936562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.936564:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294319744 00000100:00100000:1.0:1782487585.936574:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320256 00000100:00100000:1.0:1782487585.936580:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320256 00000100:00100000:2.0:1782487585.936589:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320128 00000100:00100000:2.0:1782487585.936594:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320128 00000100:00100000:3.0:1782487585.936597:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353209857 time 7213353119927 state 0x0 ref 1 00000100:00100000:1.0:1782487585.936628:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353219927 time 7213353119927 state 0x1 ref 2 00000100:00100000:3.0:1782487585.936643:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353219927 time 7213353119927 state 0x1 ref 3 00000100:00100000:2.0:1782487585.936653:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213353219927 time 7213353119927 state 0x1 ref 3 00000100:00100000:1.0:1782487585.936662:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213358152093 time 7213358052093 state 0x1 ref 3 00000100:00100000:2.0:1782487585.936676:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213358166150 time 7213358066150 state 0x1 ref 3 00000100:00100000:1.0:1782487585.936678:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1098:294466:x1869066294320256:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:2.0:1782487585.936693:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1098:294465:x1869066294319744:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.936706:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.936709:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 0 deadline 7213358166150 time 7213358098221 state 0x0 ref 3 00000100:00100000:3.0:1782487585.936728:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1098:294472:x1869066294320128:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.936728:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c7aa lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cd4 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.936730:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.936752:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c79c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ccd expref: 1099 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936754:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.936769:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c7b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cdb expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.936772:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:2.0:1782487585.936783:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c7aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cd4 expref: 1099 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.936784:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.936796:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c7aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cd4 expref: 1099 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.936817:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105700) 00010000:00010000:2.0:1782487585.936819:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.936822:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498400, rc 0) 00010000:00010000:1.0:1782487585.936836:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.936846:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.936855:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.936865:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1099:294465:x1869066294319744:12345-192.168.202.21@tcp:101:touch.500 Request processed in 177us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.936872:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26949 00010000:00010000:3.0:1782487585.936892:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936905:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936915:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936930:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936939:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.936948:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.937033:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2ce5519 reply state 0000000086376df4 transno 8589956830 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.937042:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.937104:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1100:294466:x1869066294320256:12345-192.168.202.21@tcp:36:touch.500 Request processed in 430us (572us total) trans 8589956830 rc 0/0 00000100:00100000:1.0:1782487585.937110:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26948 00010000:00010000:1.0:1782487585.937654:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937662:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937668:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937674:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.937678:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937685:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937694:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:1.0:1782487585.937696:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.937700:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.937706:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c7b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487585.937717:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1849:0x0], index 1: 0 00000100:00100000:1.0:1782487585.937861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.937896:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320512 00000100:00100000:2.0:1782487585.937900:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320512 00000100:00100000:1.0:1782487585.937915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.937920:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 0 deadline 7213358198221 time 7213358098221 state 0x1 ref 2 00000100:00100000:2.0:1782487585.937940:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213358198221 time 7213359331194 state 0x0 ref 2 00000100:00100000:2.0:1782487585.937953:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1100:294466:x1869066294320512:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.937957:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c7cd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.937962:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.937977:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c7d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ce2 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.938002:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce2 expref: 1101 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938018:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c7cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.938019:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce2 expref: 1101 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938032:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c7cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.938042:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.938046:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.938048:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498600, rc 0) 00010000:00010000:3.0:1782487585.938073:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.938074:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1101:294466:x1869066294320512:12345-192.168.202.21@tcp:101:touch.500 Request processed in 125us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.938088:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26951 00010000:00010000:3.0:1782487585.938089:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938097:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938103:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.938108:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938115:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938126:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.938130:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.938133:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938140:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c7bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.938153:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000daa7af3c reply state 00000000c80bc019 transno 8589956831 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.938161:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.938235:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c7b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cdb expref: 1101 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938257:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c7cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cdb expref: 1100 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.938266:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:3.0:1782487585.938269:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.938273:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71a00, rc 0) 00000100:00100000:3.0:1782487585.938311:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1101:294472:x1869066294320128:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1589us (1748us total) trans 8589956831 rc 0/0 00000100:00100000:3.0:1782487585.938319:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26950 00000100:00100000:3.0:1782487585.938325:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213358198221 time 7213359331194 state 0x2 ref 0 00000100:00100000:3.0:1782487585.938361:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320384 00000100:00100000:3.0:1782487585.938366:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320384 00000100:00100000:3.0:1782487585.938406:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16174 00000100:00100000:3.0:1782487585.938416:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2360:x1869066294320384:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.938698:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2360:x1869066294320384:12345-192.168.202.21@tcp:2:touch.500 Request processed in 283us (782us total) trans 8589940000 rc 0/0 00000100:00100000:3.0:1782487585.938707:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16174 00000100:00100000:2.0:1782487585.939258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.939299:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320640 00000100:00100000:3.0:1782487585.939304:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320640 00000100:00100000:3.0:1782487585.939340:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16175 00010000:00010000:1.0:1782487585.939344:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.939352:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2362:x1869066294320640:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:1.0:1782487585.939359:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.939368:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.939375:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.939380:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.939388:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.939406:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487585.939409:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.939414:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.939421:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c7c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.939545:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+113:2362:x1869066294320640:12345-192.168.202.21@tcp:2:touch.500 Request processed in 196us (288us total) trans 8589940662 rc 0/0 00000100:00100000:3.0:1782487585.939557:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16175 00000100:00100000:2.0:1782487585.939947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.939982:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320768 00000100:00100000:3.0:1782487585.939987:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320768 00000100:00100000:3.0:1782487585.940006:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213358198221 time 7213359331194 state 0x0 ref 1 00000100:00100000:2.0:1782487585.940012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.940020:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213359431194 time 7213359331194 state 0x1 ref 1 00000100:00100000:3.0:1782487585.940040:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294320896 00000100:00100000:3.0:1782487585.940044:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294320896 00000100:00100000:3.0:1782487585.940060:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213359431194 time 7213359331194 state 0x1 ref 2 00000100:00100000:1.0:1782487585.940071:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213361560375 time 7213361460375 state 0x1 ref 2 00000100:00100000:2.0:1782487585.940080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.940085:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213361560375 time 7213361474880 state 0x0 ref 2 00000100:00100000:1.0:1782487585.940086:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1101:294473:x1869066294320768:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.940103:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.940108:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1101:294481:x1869066294320896:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:2.0:1782487585.940114:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294321152 00000100:00100000:2.0:1782487585.940119:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294321152 00010000:00010000:1.0:1782487585.940119:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c7e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ce9 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940120:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.940143:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213361574880 time 7213361474880 state 0x1 ref 3 00010000:00010000:1.0:1782487585.940162:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940167:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 0 deadline 7213361574880 time 7213361556428 state 0x0 ref 3 00010000:00010000:1.0:1782487585.940175:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940183:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940184:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1103:294472:x1869066294321152:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.940214:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940220:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940229:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940231:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487585.940235:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c7f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cf0 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940252:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c7cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cdb expref: 1104 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940269:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:3.0:1782487585.940274:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940280:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.940290:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940299:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940315:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940320:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940325:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940329:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940348:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940350:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940358:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.940367:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940372:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.940394:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaf7:0x0]: returning size 0 00000004:00200000:1.0:1782487585.940399:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.940414:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940425:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940436:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940442:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940448:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940453:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.940458:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940459:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940479:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940480:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.940483:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003300ab0d reply state 000000006861b810 transno 8589956832 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940501:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:2.0:1782487585.940502:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.940504:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940508:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.940513:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940521:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c7e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.940528:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafa:0x0]: returning size 0 00000004:00200000:3.0:1782487585.940532:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.940535:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940542:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.940546:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940548:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940558:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1105:294472:x1869066294321152:12345-192.168.202.21@tcp:36:touch.500 Request processed in 375us (477us total) trans 8589956832 rc 0/0 00010000:00010000:3.0:1782487585.940563:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940564:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.940572:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940576:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26954 00010000:00010000:3.0:1782487585.940579:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940588:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940599:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.940602:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.940626:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940634:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c7f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.940660:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940670:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940677:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c7e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce9 expref: 1105 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940686:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.940693:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940701:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940703:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce9 expref: 1104 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940719:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487585.940721:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.940722:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.940726:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.940732:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.940736:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54834c800, rc 0) 00010000:00010000:3.0:1782487585.940740:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c7fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.940760:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940768:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.940775:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294321408 00000100:00100000:1.0:1782487585.940781:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294321408 00000100:00100000:2.0:1782487585.940790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.940812:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940819:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a2c13800 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:2.0:1782487585.940820:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294321664 00010000:00010000:3.0:1782487585.940824:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.940825:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294321664 00000100:00100000:1.0:1782487585.940826:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5756 00010000:00010000:3.0:1782487585.940838:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.940845:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1106:294465:x1869066294321408:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.940859:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5757 00010000:00010000:3.0:1782487585.940864:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.940868:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782487585.940871:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5482fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1106:294466:x1869066294321664:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487585.940873:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940884:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a2c13800/0x66475b4e8b85c80c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940917:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c7f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf0 expref: 1107 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940933:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf0 expref: 1106 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.940941:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:3.0:1782487585.940945:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.940948:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54151a000, rc 0) 00000100:00100000:3.0:1782487585.940986:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1108:294481:x1869066294320896:12345-192.168.202.21@tcp:101:rm.500 Request processed in 881us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.940994:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26953 00000100:00100000:3.0:1782487585.941017:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294321792 00000100:00100000:3.0:1782487585.941021:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294321792 00000100:00100000:3.0:1782487585.941040:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 0 deadline 7213361656428 time 7213361556428 state 0x1 ref 2 00000100:00100000:1.0:1782487585.941047:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1108:294465:x1869066294321408:12345-192.168.202.21@tcp:35:touch.500 Request processed in 205us (392us total) trans 8589956833 rc 0/0 00000100:00100000:1.0:1782487585.941058:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5756 00000100:00100000:3.0:1782487585.941064:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213361656428 time 7213362453888 state 0x0 ref 2 00000100:00100000:3.0:1782487585.941078:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb575e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1107:294482:x1869066294321792:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:2.0:1782487585.941088:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5482fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1107:294466:x1869066294321664:12345-192.168.202.21@tcp:35:touch.500 Request processed in 219us (345us total) trans 8589956834 rc 0/0 00010000:00010000:3.0:1782487585.941090:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.941097:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1107:294473:x1869066294320768:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1013us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.941105:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5757 00000100:00100000:1.0:1782487585.941110:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26952 00010000:00010000:3.0:1782487585.941161:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c821 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cf7 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941196:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941216:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941219:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941227:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941233:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941237:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941247:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45019ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.941251:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941253:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941265:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941268:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941283:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941285:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:1.0:1782487585.941292:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.941297:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941304:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45019ac00/0x66475b4e8b85c813 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941443:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941452:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.941461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.941465:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.941484:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafb:0x0]: returning size 0 00000004:00200000:3.0:1782487585.941488:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487585.941498:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941507:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941515:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.941518:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294321920 00010000:00010000:3.0:1782487585.941522:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.941527:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294321920 00010000:00010000:3.0:1782487585.941531:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941539:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.941543:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.941548:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213362553888 time 7213362453888 state 0x1 ref 2 00010000:00010000:3.0:1782487585.941552:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941565:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.941569:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.941573:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.941577:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213362553888 time 7213362966516 state 0x0 ref 2 00010000:00010000:3.0:1782487585.941584:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c828 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.941593:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1106:294472:x1869066294321920:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.941599:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941603:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.941633:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941635:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c83d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d1a expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941645:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941662:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.941667:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941673:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941684:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4d2ebc200) 00010000:00010000:1.0:1782487585.941685:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c83d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d1a expref: 1107 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941689:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.941694:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941703:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c83d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d1a expref: 1107 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941704:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c82f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.941730:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487585.941734:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.941737:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551526e00, rc 0) 00010000:00010000:3.0:1782487585.941745:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c821 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf7 expref: 1108 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941759:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf7 expref: 1107 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.941767:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487585.941772:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1782487585.941772:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1107:294472:x1869066294321920:12345-192.168.202.21@tcp:101:touch.500 Request processed in 179us (312us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.941777:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00000100:00100000:1.0:1782487585.941786:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26956 00000100:00100000:3.0:1782487585.941809:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb575e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1106:294482:x1869066294321792:12345-192.168.202.21@tcp:101:rm.500 Request processed in 733us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.941817:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26955 00000100:00100000:3.0:1782487585.941822:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213362553888 time 7213362966516 state 0x2 ref 0 00000100:00100000:2.0:1782487585.942599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.942640:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322048 00000100:00100000:3.0:1782487585.942646:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322048 00000100:00100000:3.0:1782487585.942690:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16176 00000100:00100000:3.0:1782487585.942699:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2360:x1869066294322048:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.942709:0:213693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.942724:0:213693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d36 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.942744:0:213693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1847:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.942758:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.942762:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.942771:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 91 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.942786:0:213693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 91 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.942797:0:213693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45019b400, rc 0) 00000100:00100000:3.0:1782487585.942832:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2360:x1869066294322048:12345-192.168.202.21@tcp:101:rm.500 Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.942840:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16176 00000100:00100000:2.0:1782487585.942939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.943008:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322176 00000100:00100000:3.0:1782487585.943013:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322176 00000100:00100000:1.0:1782487585.943066:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16177 00000100:00100000:1.0:1782487585.943078:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+113:2363:x1869066294322176:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487585.943088:0:190931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.943103:0:190931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d3d expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487585.943121:0:190931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186c:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487585.943132:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487585.943136:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.943143:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 114 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.943159:0:190931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 114 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.943170:0:190931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196c000, rc 0) 00000100:00100000:2.0:1782487585.943188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.943216:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2363:x1869066294322176:12345-192.168.202.21@tcp:101:rm.500 Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.943225:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16177 00000100:00100000:2.0:1782487585.943232:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322304 00000100:00100000:2.0:1782487585.943238:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322304 00000100:00100000:2.0:1782487585.943282:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1145 00000100:00100000:2.0:1782487585.943291:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1106:2363:x1869066294322304:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487585.943325:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.943336:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c852 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477cfe expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943369:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943384:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943393:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943407:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943415:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943423:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943513:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943523:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943532:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.943547:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafd:0x0]: returning size 0 00000004:00200000:2.0:1782487585.943551:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.943563:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943573:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943585:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943592:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943599:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943633:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.943638:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943646:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943657:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.943660:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.943664:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943671:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85c859 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943685:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943691:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943699:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943705:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.943709:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943717:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943726:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c5d1a800) 00010000:00010000:2.0:1782487585.943729:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.943732:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943738:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85c860 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943766:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85c852 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cfe expref: 1108 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943780:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cfe expref: 1107 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943788:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.943791:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.943794:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45653dc00, rc 0) 00010000:00010000:2.0:1782487585.943799:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.943809:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c86e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d05 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943837:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943846:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943854:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943867:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943874:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943882:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943940:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943949:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943957:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.943971:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafc:0x0]: returning size 0 00000004:00200000:2.0:1782487585.943973:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.943984:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.943997:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944005:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944012:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944019:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944025:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944029:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944036:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944046:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.944049:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944052:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944059:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85c875 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944071:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944078:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944085:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944091:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944095:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944102:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944111:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4b6109000) 00010000:00010000:2.0:1782487585.944114:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944117:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944124:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85c87c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944150:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85c86e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d05 expref: 1109 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944164:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d05 expref: 1108 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944171:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105700) 00010000:00010000:2.0:1782487585.944174:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.944177:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb541391600, rc 0) 00010000:00010000:2.0:1782487585.944182:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.944190:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c88a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d0c expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944225:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944234:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944243:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944259:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944266:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944275:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944336:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944345:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944353:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.944368:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487585.944378:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944391:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944399:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944406:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944413:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944419:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944422:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944429:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944438:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.944441:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944445:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944451:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85c891 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944464:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944470:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944477:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944483:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944487:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944494:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944504:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb451f41500) 00010000:00010000:2.0:1782487585.944507:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944510:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944517:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c898 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944543:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85c88a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d0c expref: 1110 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944557:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d0c expref: 1109 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944565:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487585.944568:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.944571:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07a00, rc 0) 00010000:00010000:2.0:1782487585.944577:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.944585:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c8a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d13 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944629:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944639:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944648:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944662:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944670:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944678:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944712:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944719:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944725:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944731:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb456343400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944735:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944747:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944758:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.944761:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944765:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944771:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb456343400/0x66475b4e8b85c8ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944782:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944789:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944796:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944801:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.944805:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944811:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944820:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb451f41600) 00010000:00010000:2.0:1782487585.944822:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.944826:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944832:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944857:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c8a6 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d13 expref: 1110 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944867:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.944870:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.944875:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c8a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d13 expref: 1110 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.944886:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd06a00, rc -2) 00000100:00100000:2.0:1782487585.944936:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1109:2363:x1869066294322304:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1646us (1749us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487585.944945:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1145 00000100:00100000:3.0:1782487585.945315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.945349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.945393:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322688 00000100:00100000:1.0:1782487585.945400:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322688 00000100:00100000:3.0:1782487585.945401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.945427:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213362553888 time 7213362966516 state 0x0 ref 1 00000100:00100000:1.0:1782487585.945440:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213363066516 time 7213362966516 state 0x1 ref 1 00000100:00100000:2.0:1782487585.945470:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322432 00000100:00100000:1.0:1782487585.945475:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213363066516 time 7213366863771 state 0x0 ref 1 00000100:00100000:2.0:1782487585.945476:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322432 00000100:00100000:1.0:1782487585.945492:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1109:294477:x1869066294322688:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.945507:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.945514:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294322816 00000100:00100000:2.0:1782487585.945518:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294322816 00010000:00010000:1.0:1782487585.945520:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c8bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d4b expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.945526:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16178 00000100:00100000:3.0:1782487585.945542:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2361:x1869066294322432:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487585.945553:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16179 00000100:00100000:2.0:1782487585.945565:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2361:x1869066294322816:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.945573:0:200304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.945591:0:200304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d52 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487585.945654:0:200304:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186e:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.945670:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.945675:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487585.945678:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.945685:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 115 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.945693:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.945703:0:200304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 115 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.945707:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.945721:0:200304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45f92da00, rc 0) 00010000:00010000:1.0:1782487585.945732:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.945743:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.945752:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.945754:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2361:x1869066294322816:12345-192.168.202.21@tcp:101:rm.500 Request processed in 192us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.945772:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16179 00000100:00100000:3.0:1782487585.945882:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294322432:12345-192.168.202.21@tcp:2:touch.500 Request processed in 343us (568us total) trans 8589940001 rc 0/0 00000100:00100000:3.0:1782487585.945891:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16178 00000004:00080000:1.0:1782487585.946298:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1870:0x0], index 0: 0 00010000:00010000:1.0:1782487585.946457:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c8d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946468:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946478:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c8d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946506:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946513:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946520:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946527:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.946531:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946539:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946555:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.946558:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.946562:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946569:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c8c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.946582:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6a7ab13 reply state 0000000043ac5aa4 transno 8589956835 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.946590:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.946658:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c8bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d4b expref: 1112 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946673:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c8d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d4b expref: 1111 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.946682:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487585.946685:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.946688:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474401600, rc 0) 00000100:00100000:1.0:1782487585.946726:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294477:x1869066294322688:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1238us (1378us total) trans 8589956835 rc 0/0 00000100:00100000:1.0:1782487585.946735:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26957 00000100:00100000:1.0:1782487585.946742:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213363066516 time 7213366863771 state 0x2 ref 0 00000100:00100000:2.0:1782487585.949278:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.949317:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323072 00000100:00100000:1.0:1782487585.949325:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323072 00000100:00100000:2.0:1782487585.949334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.949361:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.949376:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5758 00000100:00100000:1.0:1782487585.949389:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294472:x1869066294323072:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.949398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.949430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.949454:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323712 00000100:00100000:2.0:1782487585.949458:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323712 00000100:00100000:2.0:1782487585.949500:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323840 00000100:00100000:2.0:1782487585.949503:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323840 00000100:00100000:2.0:1782487585.949524:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16180 00000100:00100000:2.0:1782487585.949532:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2361:x1869066294323712:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:2.0:1782487585.949541:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.949557:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d59 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487585.949580:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x186f:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.949591:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.949595:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.949601:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 116 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.949681:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16181 00010000:00010000:2.0:1782487585.949696:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 116 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.949697:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294323840:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.949709:0:213384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.949711:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb576a0c800, rc 0) 00000100:00100000:1.0:1782487585.949715:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1113:294472:x1869066294323072:12345-192.168.202.21@tcp:35:touch.500 Request processed in 326us (438us total) trans 8589956836 rc 0/0 00010000:00010000:3.0:1782487585.949724:0:213384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d60 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.949727:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5758 00000100:00100000:2.0:1782487585.949736:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2361:x1869066294323712:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 204us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.949743:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16180 00002000:00010000:3.0:1782487585.949745:0:213384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1848:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.949756:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.949768:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.949774:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 93 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949783:0:213384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 93 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949790:0:213384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45019ac00, rc 0) 00000100:00100000:2.0:1782487585.949810:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323328 00000100:00100000:3.0:1782487585.949814:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294323840:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 123us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.949815:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323328 00000100:00100000:3.0:1782487585.949823:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16181 00000100:00100000:2.0:1782487585.949832:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213363066516 time 7213366863771 state 0x0 ref 1 00000100:00100000:2.0:1782487585.949841:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213366963771 time 7213366863771 state 0x1 ref 1 00010000:00010000:3.0:1782487585.949854:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949861:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.949862:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323584 00000100:00100000:2.0:1782487585.949866:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323584 00010000:00010000:3.0:1782487585.949869:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949874:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.949878:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.949879:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213366963771 time 7213366863771 state 0x1 ref 2 00010000:00010000:3.0:1782487585.949892:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949903:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c9e2fc00) 00000100:00100000:2.0:1782487585.949906:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213371396263 time 7213371296263 state 0x1 ref 2 00010000:00010000:3.0:1782487585.949907:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.949911:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.949917:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85c8d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.949918:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1114:294477:x1869066294323328:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487585.949946:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487585.949959:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213371396263 time 7213371348314 state 0x0 ref 2 00010000:00010000:2.0:1782487585.949961:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c8d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d4b expref: 1113 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.949982:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4c9e2fd00) 00000100:00100000:3.0:1782487585.949984:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294461:x1869066294323584:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.949991:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.950012:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.950027:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c702 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c95 expref: 1112 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.950038:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950046:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c415 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c25 expref: 1111 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.950048:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.950061:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950062:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487585.950074:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.950088:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950095:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950102:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950115:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950120:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950125:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.950136:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf2855b7 reply state 00000000effdb1ea transno 8589956837 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.950143:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.950184:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294477:x1869066294323328:12345-192.168.202.21@tcp:36:touch.500 Request processed in 268us (850us total) trans 8589956837 rc 0/0 00000100:00100000:2.0:1782487585.950191:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26958 00010000:00010000:3.0:1782487585.950231:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950240:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950247:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.950248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.950274:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294323968 00000100:00100000:3.0:1782487585.950277:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294323968 00000100:00100000:3.0:1782487585.950316:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16182 00000100:00100000:3.0:1782487585.950324:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294323968:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487585.950330:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.950348:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d67 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487585.950359:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1849:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487585.950367:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487585.950370:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487585.950374:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 94 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950417:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 94 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.950424:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a2c13800, rc 0) 00000100:00100000:3.0:1782487585.950450:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294323968:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 129us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.950456:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16182 00010000:00010000:1.0:1782487585.950983:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.950994:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951003:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.951008:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2532, 64 off170240 00010000:00010000:1.0:1782487585.951010:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.951016:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951024:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951037:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4a4c88700) 00010000:00010000:1.0:1782487585.951041:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.951045:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951051:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c8f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951093:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951103:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951116:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951124:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951132:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951138:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951161:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.951173:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951180:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.951181:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951188:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951191:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951217:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.951222:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.951223:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951229:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951235:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951239:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951258:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb49c365f00) 00010000:00010000:3.0:1782487585.951262:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.951266:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951266:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf6:0x0].0x0 (ffff9cb49c365f00) 00010000:00010000:2.0:1782487585.951272:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.951279:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c916 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951280:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951297:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c908 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.951303:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.951308:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.951311:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.951318:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951327:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951333:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951339:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.951343:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951351:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951360:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.951363:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.951367:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.951373:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c8fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.951385:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a25e4496 reply state 0000000088599569 transno 8589956838 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.951398:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.951446:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294461:x1869066294323584:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1468us (2084us total) trans 8589956838 rc 0/0 00000100:00100000:2.0:1782487585.951460:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26959 00000100:00100000:2.0:1782487585.951467:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213371396263 time 7213371348314 state 0x2 ref 0 00000100:00100000:3.0:1782487585.951533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.951657:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294324096 00000100:00100000:1.0:1782487585.951714:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294324096 00000100:00100000:1.0:1782487585.951734:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213371396263 time 7213371348314 state 0x0 ref 1 00000100:00100000:1.0:1782487585.951744:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213371448314 time 7213371348314 state 0x1 ref 1 00000100:00100000:1.0:1782487585.951768:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213371448314 time 7213373158907 state 0x0 ref 1 00000100:00100000:1.0:1782487585.951780:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294477:x1869066294324096:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.951790:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.951803:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c91d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d6e expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951837:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c91d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d6e expref: 1113 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951848:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c91d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d6e expref: 1113 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.951863:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487585.951866:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.951869:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc 0) 00000100:00100000:1.0:1782487585.952032:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1113:294477:x1869066294324096:12345-192.168.202.21@tcp:101:touch.500 Request processed in 198us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.952040:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26960 00000100:00100000:1.0:1782487585.952046:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213371448314 time 7213373158907 state 0x2 ref 0 00010000:00010000:3.0:1782487585.952079:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952088:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952094:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952100:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.952104:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952111:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952121:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4d2ebc200) 00010000:00010000:3.0:1782487585.952124:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.952127:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.952133:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c901 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.953001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.953046:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294324352 00000100:00100000:1.0:1782487585.953051:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294324352 00000100:00100000:1.0:1782487585.953079:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213371448314 time 7213373158907 state 0x0 ref 1 00000100:00100000:1.0:1782487585.953093:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213373258907 time 7213373158907 state 0x1 ref 1 00000100:00100000:1.0:1782487585.953117:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213373258907 time 7213374507837 state 0x0 ref 1 00000100:00100000:1.0:1782487585.953127:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294474:x1869066294324352:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.953155:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.953170:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c73a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c9c expref: 1112 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953187:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85c5d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c72 expref: 1111 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953197:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487585.953217:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.953234:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953245:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953255:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953266:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953272:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953278:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953376:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953385:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953392:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.953897:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2533, 64 off170304 00010000:00010000:1.0:1782487585.953970:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953978:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953987:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.953995:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954001:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954008:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954029:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.954045:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954049:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.954060:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954063:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954069:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954076:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb75e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.954079:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.954082:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954085:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954099:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954100:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954176:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487585.954179:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.954182:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf8:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487585.954183:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954188:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487585.954196:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954196:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c932 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954218:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c939 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954233:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954240:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.954243:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.954244:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.954248:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.954253:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954258:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.954262:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954267:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954276:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.954278:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.954280:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.954284:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85c924 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.954295:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab27f8a8 reply state 00000000dc235b17 transno 8589956839 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.954302:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.954364:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294474:x1869066294324352:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1238us (1365us total) trans 8589956839 rc 0/0 00000100:00100000:1.0:1782487585.954371:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26961 00000100:00100000:1.0:1782487585.954376:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213373258907 time 7213374507837 state 0x2 ref 0 00000100:00100000:3.0:1782487585.954446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.954484:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294324480 00000100:00100000:1.0:1782487585.954490:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294324480 00000100:00100000:1.0:1782487585.954531:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16183 00000100:00100000:1.0:1782487585.954541:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2361:x1869066294324480:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.954846:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2361:x1869066294324480:12345-192.168.202.21@tcp:2:touch.500 Request processed in 305us (399us total) trans 8589940663 rc 0/0 00000100:00100000:1.0:1782487585.954856:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16183 00010000:00010000:1.0:1782487585.955813:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955823:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955830:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955836:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.955841:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955849:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955861:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb54b105b00) 00010000:00010000:1.0:1782487585.955865:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.955869:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.955875:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85c92b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.956123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.956175:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294324736 00000100:00100000:2.0:1782487585.956182:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294324736 00000100:00100000:2.0:1782487585.956233:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5759 00000100:00100000:2.0:1782487585.956243:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1111:294477:x1869066294324736:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.956484:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294477:x1869066294324736:12345-192.168.202.21@tcp:35:touch.500 Request processed in 242us (362us total) trans 8589956840 rc 0/0 00000100:00100000:2.0:1782487585.956492:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5759 00000100:00100000:3.0:1782487585.958044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.958085:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294324992 00000100:00100000:1.0:1782487585.958091:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294324992 00000100:00100000:1.0:1782487585.958116:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213373258907 time 7213374507837 state 0x0 ref 1 00000100:00100000:1.0:1782487585.958126:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213374607837 time 7213374507837 state 0x1 ref 1 00000100:00100000:1.0:1782487585.958144:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213374607837 time 7213379534370 state 0x0 ref 1 00000100:00100000:1.0:1782487585.958155:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294476:x1869066294324992:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487585.958185:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487585.958202:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85c733 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ca3 expref: 1112 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958230:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85c61b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c79 expref: 1111 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958239:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:1.0:1782487585.958247:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.958262:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958272:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958278:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958290:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958297:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958304:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958398:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958405:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958411:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487585.958850:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2539, 64 off170688 00010000:00010000:1.0:1782487585.958910:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958917:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958923:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958929:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958934:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958938:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958963:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.958976:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.958982:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.958991:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.958993:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.958999:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959001:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.959008:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.959010:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.959016:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.959024:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959027:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.959041:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:2.0:1782487585.959045:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487585.959049:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959054:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf9:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:2.0:1782487585.959055:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c955 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959060:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.959066:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.959070:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.959073:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.959076:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.959076:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c94e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959101:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959107:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959114:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959120:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.959124:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959135:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959144:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.959147:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.959151:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.959157:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c940 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.959169:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068f67424 reply state 00000000419c4118 transno 8589956841 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.959178:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487585.959244:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1112:294476:x1869066294324992:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1089us (1203us total) trans 8589956841 rc 0/0 00000100:00100000:1.0:1782487585.959253:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26962 00000100:00100000:1.0:1782487585.959259:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213374607837 time 7213379534370 state 0x2 ref 0 00010000:00010000:1.0:1782487585.961599:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.961636:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.961644:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.961651:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.961656:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.961664:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.961673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.961678:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487585.961681:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.961686:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.961692:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85c947 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.961877:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294325248 00000100:00100000:2.0:1782487585.961883:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294325248 00000100:00100000:2.0:1782487585.961908:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213374607837 time 7213379534370 state 0x0 ref 1 00000100:00100000:2.0:1782487585.961917:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213379634370 time 7213379534370 state 0x1 ref 1 00000100:00100000:2.0:1782487585.961940:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213379634370 time 7213383330829 state 0x0 ref 1 00000100:00100000:2.0:1782487585.961953:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1111:294471:x1869066294325248:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.961972:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.962003:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c95c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d75 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962135:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962157:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962168:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962195:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962201:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962219:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487585.962737:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184a:0x0], index 1: 0 00010000:00010000:2.0:1782487585.962906:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c971 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962916:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962925:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962957:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962964:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962971:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962977:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.962981:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.962988:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.963004:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.963008:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.963012:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.963019:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85c963 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.963031:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ad6642a reply state 00000000264875dc transno 8589956842 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.963039:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.963066:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85c95c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d75 expref: 1114 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.963082:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c971 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d75 expref: 1113 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.963090:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487585.963093:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.963095:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e800, rc 0) 00000100:00100000:2.0:1782487585.963158:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1114:294471:x1869066294325248:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1206us (1486us total) trans 8589956842 rc 0/0 00000100:00100000:2.0:1782487585.963168:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26963 00000100:00100000:2.0:1782487585.963173:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213379634370 time 7213383330829 state 0x2 ref 0 00010000:00010000:1.0:1782487585.963977:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.963987:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.963994:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964000:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.964004:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964012:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964024:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4a4c88c00) 00010000:00010000:1.0:1782487585.964027:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.964032:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964038:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85c96a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.964491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.964529:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294325632 00000100:00100000:1.0:1782487585.964535:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294325632 00000100:00100000:3.0:1782487585.964550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.964557:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213379634370 time 7213383330829 state 0x0 ref 1 00000100:00100000:1.0:1782487585.964566:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213383430829 time 7213383330829 state 0x1 ref 1 00000100:00100000:1.0:1782487585.964584:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294325760 00000100:00100000:1.0:1782487585.964586:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294325760 00000100:00100000:2.0:1782487585.964599:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213383430829 time 7213385986978 state 0x0 ref 2 00000100:00100000:1.0:1782487585.964639:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213386086978 time 7213385986978 state 0x1 ref 2 00000100:00100000:2.0:1782487585.964647:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1114:294471:x1869066294325632:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487585.964664:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213386086978 time 7213386054448 state 0x0 ref 2 00000100:00100000:1.0:1782487585.964678:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1114:294479:x1869066294325760:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.964684:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.964689:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.964698:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85c971 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d75 expref: 1114 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964703:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c97f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d7c expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.964709:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487585.964717:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.964778:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.964788:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.964794:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964806:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964815:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964822:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964836:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964842:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.964847:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.964875:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f81e098 reply state 000000000bb35a3a transno 8589956843 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.964881:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.964959:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1116:294471:x1869066294325632:12345-192.168.202.21@tcp:36:touch.500 Request processed in 318us (470us total) trans 8589956843 rc 0/0 00000100:00100000:2.0:1782487585.964965:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26964 00000004:00080000:1.0:1782487585.965164:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1871:0x0], index 0: 0 00010000:00010000:1.0:1782487585.965293:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c99b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965302:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c99b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965310:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c99b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965331:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965339:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965344:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965350:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.965353:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965363:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965373:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.965375:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.965377:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965381:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c98d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.965389:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f5b7f67 reply state 00000000a63fe3d3 transno 8589956844 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.965393:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.965409:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c97f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d7c expref: 1117 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965419:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c99b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d7c expref: 1116 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965424:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:1.0:1782487585.965426:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.965428:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71a00, rc 0) 00000100:00100000:1.0:1782487585.965460:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1117:294479:x1869066294325760:12345-192.168.202.21@tcp:101:touch.500 Request processed in 786us (911us total) trans 8589956844 rc 0/0 00000100:00100000:1.0:1782487585.965469:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26965 00000100:00100000:1.0:1782487585.965474:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213386086978 time 7213386054448 state 0x2 ref 0 00010000:00010000:1.0:1782487585.965505:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965510:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965515:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965518:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.965521:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965526:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965534:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:1.0:1782487585.965535:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.965538:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965542:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85c986 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.965721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.965751:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294325888 00000100:00100000:1.0:1782487585.965756:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294325888 00000100:00100000:1.0:1782487585.965773:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213386086978 time 7213386054448 state 0x0 ref 1 00000100:00100000:1.0:1782487585.965787:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213386154448 time 7213386054448 state 0x1 ref 1 00000100:00100000:1.0:1782487585.965822:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213386154448 time 7213387211864 state 0x0 ref 1 00000100:00100000:1.0:1782487585.965838:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1116:294471:x1869066294325888:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.965848:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.965861:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c9a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d83 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965892:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d83 expref: 1117 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965903:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d83 expref: 1117 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.965919:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:1.0:1782487585.965922:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.965925:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70a00, rc 0) 00000100:00100000:1.0:1782487585.965960:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1117:294471:x1869066294325888:12345-192.168.202.21@tcp:101:touch.500 Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.965969:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26966 00000100:00100000:1.0:1782487585.965974:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213386154448 time 7213387211864 state 0x2 ref 0 00010000:00010000:1.0:1782487585.966012:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966020:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966027:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966036:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.966039:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966044:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966055:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.966058:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.966062:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.966068:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c994 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.971098:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.971135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.971142:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294326016 00000100:00100000:1.0:1782487585.971152:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294326016 00000100:00100000:3.0:1782487585.971186:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294326528 00000100:00100000:3.0:1782487585.971192:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294326528 00000100:00100000:2.0:1782487585.971198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.971233:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16184 00000100:00100000:1.0:1782487585.971246:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294326016:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487585.971322:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213386154448 time 7213387211864 state 0x0 ref 1 00000100:00100000:3.0:1782487585.971335:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213387311864 time 7213387211864 state 0x1 ref 1 00000100:00100000:3.0:1782487585.971372:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294326400 00000100:00100000:3.0:1782487585.971376:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294326400 00000100:00100000:3.0:1782487585.971396:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213387311864 time 7213387211864 state 0x1 ref 2 00000100:00100000:2.0:1782487585.971427:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213392902415 time 7213392802415 state 0x1 ref 2 00000100:00100000:3.0:1782487585.971454:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392902415 time 7213392843406 state 0x0 ref 2 00000100:00100000:2.0:1782487585.971461:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1117:294479:x1869066294326528:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487585.971470:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1117:294480:x1869066294326400:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487585.971483:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.971503:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c9b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d8a expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.971507:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.971533:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85c99b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d7c expref: 1118 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.971571:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294326016:12345-192.168.202.21@tcp:2:touch.500 Request processed in 328us (478us total) trans 8589940002 rc 0/0 00000100:00100000:1.0:1782487585.971581:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16184 00010000:00010000:2.0:1782487585.971657:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb54b105b00) 00010000:00010000:2.0:1782487585.971669:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.971720:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.971786:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.971799:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971829:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971846:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971858:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971876:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971884:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.971891:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.971944:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d713f0ca reply state 00000000cdacefee transno 8589956845 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.971954:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.972017:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1119:294479:x1869066294326528:12345-192.168.202.21@tcp:36:touch.500 Request processed in 560us (880us total) trans 8589956845 rc 0/0 00000100:00100000:2.0:1782487585.972025:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26967 00000004:00080000:3.0:1782487585.972384:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184b:0x0], index 1: 0 00010000:00010000:3.0:1782487585.972509:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c9cc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972519:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c9cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972527:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c9cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972553:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972560:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972567:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972574:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.972579:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972585:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972595:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.972598:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.972601:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972628:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85c9be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.972639:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050072b20 reply state 00000000a903c5a0 transno 8589956846 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.972645:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.972666:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85c9b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d8a expref: 1120 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972680:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c9cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d8a expref: 1119 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.972744:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:3.0:1782487585.972747:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.972750:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44fb75e00, rc 0) 00000100:00100000:3.0:1782487585.972789:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1120:294480:x1869066294326400:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1324us (1590us total) trans 8589956846 rc 0/0 00000100:00100000:3.0:1782487585.972798:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26968 00000100:00100000:3.0:1782487585.972803:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392902415 time 7213392843406 state 0x2 ref 0 00010000:00010000:1.0:1782487585.973729:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973741:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973748:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973754:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.973759:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973765:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973777:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb4a4c88400) 00010000:00010000:1.0:1782487585.973781:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.973786:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973798:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973799:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.973817:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85c9b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973822:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973831:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.973835:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973842:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973855:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb55a37bf00) 00010000:00010000:2.0:1782487585.973858:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.973862:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.973869:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85c9c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.974844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.974883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.974887:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294326656 00000100:00100000:1.0:1782487585.974896:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294326656 00000100:00100000:2.0:1782487585.974916:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.974921:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294326912 00000100:00100000:3.0:1782487585.974927:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294326912 00000100:00100000:1.0:1782487585.974933:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392902415 time 7213392843406 state 0x0 ref 1 00000100:00100000:1.0:1782487585.974945:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392943406 time 7213392843406 state 0x1 ref 1 00000100:00100000:2.0:1782487585.974953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.974971:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294327424 00000100:00100000:3.0:1782487585.974973:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5760 00000100:00100000:1.0:1782487585.974975:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294327424 00000100:00100000:3.0:1782487585.974989:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1120:294471:x1869066294326912:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.974996:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392943406 time 7213392843406 state 0x1 ref 2 00000100:00100000:2.0:1782487585.975003:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294327296 00000100:00100000:2.0:1782487585.975009:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294327296 00000100:00100000:2.0:1782487585.975032:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213392943406 time 7213392843406 state 0x1 ref 3 00000100:00100000:1.0:1782487585.975041:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396530834 time 7213396430834 state 0x1 ref 3 00000100:00100000:1.0:1782487585.975053:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1121:294479:x1869066294326656:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487585.975058:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213396546942 time 7213396446942 state 0x1 ref 3 00010000:00010000:1.0:1782487585.975063:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487585.975073:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1121:294480:x1869066294327424:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.975078:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c9da lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d91 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.975105:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.975122:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb75e00/0x66475b4e8b85c9cc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d8a expref: 1122 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975124:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c9da lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d91 expref: 1122 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.975146:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487585.975157:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.975160:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c9da lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d91 expref: 1122 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975176:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487585.975179:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.975181:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71c00, rc 0) 00000100:00100000:1.0:1782487585.975236:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1122:294479:x1869066294326656:12345-192.168.202.21@tcp:101:touch.500 Request processed in 185us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.975245:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26969 00000100:00100000:1.0:1782487585.975273:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396546942 time 7213396663127 state 0x0 ref 2 00000100:00100000:1.0:1782487585.975290:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1121:294483:x1869066294327296:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.975298:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.975305:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1121:294471:x1869066294326912:12345-192.168.202.21@tcp:35:touch.500 Request processed in 319us (419us total) trans 8589956847 rc 0/0 00010000:00010000:1.0:1782487585.975308:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c9e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d98 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.975319:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5760 00010000:00010000:2.0:1782487585.975383:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.975395:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975407:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.975408:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975430:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975440:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975458:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975465:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.975473:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.975519:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa1f18ff reply state 000000005fae1793 transno 8589956848 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.975528:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.975603:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1123:294480:x1869066294327424:12345-192.168.202.21@tcp:36:touch.500 Request processed in 533us (686us total) trans 8589956848 rc 0/0 00000100:00100000:2.0:1782487585.975632:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26970 00000100:00100000:2.0:1782487585.975894:0:190320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190320:1869066299219328:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782487585.975909:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1872:0x0], index 0: 0 00000100:00100000:2.0:1782487585.975938:0:190320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487585.975968:0:190320:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be600 going to sleep for 11 seconds 00000100:00100000:3.0:1782487585.975980:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219328 00000100:00100000:3.0:1782487585.975986:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219328 00000100:00100000:3.0:1782487585.976034:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16185 00010000:00010000:1.0:1782487585.976053:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c9fd lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976061:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c9fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976067:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c9fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976086:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976091:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976096:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.976102:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:190320:x1869066299219328:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1782487585.976105:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.976112:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976124:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976136:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.976139:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:3.0:1782487585.976141:0:213211:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 6274 00010000:00010000:1.0:1782487585.976144:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976154:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85c9ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.976165:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031b390c8 reply state 00000000d67f54a7 transno 8589956849 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.976170:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.976189:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85c9e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d98 expref: 1124 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976213:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c9fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d98 expref: 1123 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976220:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:1.0:1782487585.976222:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.976225:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71600, rc 0) 00000100:00100000:1.0:1782487585.976257:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294483:x1869066294327296:12345-192.168.202.21@tcp:101:touch.500 Request processed in 977us (1305us total) trans 8589956849 rc 0/0 00000100:00100000:1.0:1782487585.976265:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26971 00000100:00100000:1.0:1782487585.976275:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396546942 time 7213396663127 state 0x2 ref 0 00010000:00010000:1.0:1782487585.976310:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976318:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976326:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.976335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.976339:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.976345:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976352:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976364:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487585.976367:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.976371:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976378:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85c9e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.976425:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294327552 00000100:00100000:2.0:1782487585.976430:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294327552 00000100:00100000:1.0:1782487585.976545:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16186 00000100:00100000:1.0:1782487585.976556:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294327552:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487585.976747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.976798:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+118:2360:x1869066294327552:12345-192.168.202.21@tcp:2:touch.500 Request processed in 244us (466us total) trans 8589940664 rc 0/0 00000100:00100000:1.0:1782487585.976808:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16186 00010000:00010000:1.0:1782487585.976922:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976933:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976940:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976946:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.976951:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976956:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976966:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb543a0d600) 00010000:00010000:1.0:1782487585.976968:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.976971:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.976976:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85c9f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.977510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.977544:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294327680 00000100:00100000:2.0:1782487585.977549:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294327680 00000100:00100000:2.0:1782487585.977650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.977685:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396546942 time 7213396663127 state 0x0 ref 1 00000100:00100000:2.0:1782487585.977695:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396763127 time 7213396663127 state 0x1 ref 1 00000100:00100000:2.0:1782487585.977717:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294327936 00000100:00100000:2.0:1782487585.977721:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294327936 00000100:00100000:2.0:1782487585.977736:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213396763127 time 7213396663127 state 0x1 ref 2 00000100:00100000:1.0:1782487585.977738:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328192 00000100:00100000:1.0:1782487585.977745:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328192 00000100:00100000:2.0:1782487585.977761:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399251622 time 7213399151622 state 0x1 ref 2 00000100:00100000:1.0:1782487585.977773:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399251622 time 7213399151622 state 0x1 ref 3 00000100:00100000:2.0:1782487585.977776:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294480:x1869066294327680:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.977790:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487585.977800:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213399290188 time 7213399190188 state 0x1 ref 3 00010000:00010000:2.0:1782487585.977807:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85ca0b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477d9f expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.977814:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294483:x1869066294327936:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487585.977843:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487585.977849:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85ca0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d9f expref: 1125 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.977858:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85c9fd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d98 expref: 1125 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.977863:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85ca0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d9f expref: 1125 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.977873:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487585.977881:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4a4c88a00) 00010000:00010000:1.0:1782487585.977883:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.977886:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.977891:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48b447400, rc 0) 00000100:00100000:2.0:1782487585.977923:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294480:x1869066294327680:12345-192.168.202.21@tcp:101:touch.500 Request processed in 151us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.977931:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26972 00010000:00010000:1.0:1782487585.977934:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.977945:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.977955:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.978020:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399290188 time 7213399409660 state 0x0 ref 2 00000100:00100000:2.0:1782487585.978033:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294481:x1869066294328192:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.978060:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000004:00010000:1.0:1782487585.978068:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd2778f3 reply state 00000000be582ca3 transno 8589956850 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978076:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85c81a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf0 expref: 1124 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.978079:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487585.978104:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85c6df lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xafa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c8e expref: 1124 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978118:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487585.978128:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487585.978140:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1123:294483:x1869066294327936:12345-192.168.202.21@tcp:36:touch.500 Request processed in 329us (629us total) trans 8589956850 rc 0/0 00010000:00010000:2.0:1782487585.978145:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.978151:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26973 00010000:00010000:2.0:1782487585.978161:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978171:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978187:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978196:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978213:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978305:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978311:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.978317:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487585.978975:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2534, 64 off170368 00010000:00010000:2.0:1782487585.979078:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979090:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979099:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979107:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979114:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979121:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979144:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487585.979159:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979168:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487585.979172:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979176:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979183:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979188:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487585.979194:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.979196:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979200:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979219:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979229:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979250:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4a4c88500) 00010000:00010000:1.0:1782487585.979254:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.979259:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979264:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafa:0x0].0x0 (ffff9cb4a4c88500) 00010000:00010000:1.0:1782487585.979267:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85ca2e lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979271:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.979278:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979286:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ca27 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xafa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.979288:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.979293:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.979299:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487585.979316:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979324:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979331:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979337:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.979342:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979349:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979359:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.979363:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.979367:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.979374:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ca19 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.979386:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004988adf3 reply state 00000000fbdb3927 transno 8589956851 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.979394:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487585.979442:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294481:x1869066294328192:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1408us (1791us total) trans 8589956851 rc 0/0 00000100:00100000:2.0:1782487585.979451:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26974 00000100:00100000:2.0:1782487585.979457:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399290188 time 7213399409660 state 0x2 ref 0 00000100:00100000:2.0:1782487585.980122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.980155:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328448 00000100:00100000:2.0:1782487585.980160:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328448 00000100:00100000:2.0:1782487585.980221:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5761 00000100:00100000:2.0:1782487585.980237:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294479:x1869066294328448:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.980545:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1125:294479:x1869066294328448:12345-192.168.202.21@tcp:35:touch.500 Request processed in 315us (424us total) trans 8589956852 rc 0/0 00000100:00100000:2.0:1782487585.980560:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5761 00010000:00010000:1.0:1782487585.980566:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980575:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980582:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980588:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.980593:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980601:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980630:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb543a0de00) 00010000:00010000:1.0:1782487585.980633:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.980637:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.980648:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ca12 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.980968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.981021:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.981090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.981098:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.981106:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.981112:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.981116:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.981117:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328704 00000100:00100000:2.0:1782487585.981121:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328576 00000100:00100000:3.0:1782487585.981124:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328704 00000100:00100000:2.0:1782487585.981126:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328576 00010000:00010000:1.0:1782487585.981129:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.981143:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4a4c88d00) 00000100:00100000:2.0:1782487585.981144:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399290188 time 7213399409660 state 0x0 ref 1 00010000:00010000:1.0:1782487585.981149:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.981154:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.981155:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399509660 time 7213399409660 state 0x1 ref 1 00010000:00010000:1.0:1782487585.981169:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ca20 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.981171:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16187 00000100:00100000:2.0:1782487585.981182:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399509660 time 7213402572086 state 0x0 ref 1 00000100:00100000:3.0:1782487585.981187:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2363:x1869066294328704:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487585.981197:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1123:294483:x1869066294328576:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.981244:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.981262:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85ca35 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477da6 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981294:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85ca35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477da6 expref: 1124 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981305:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85ca35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477da6 expref: 1124 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.981337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.981378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.981403:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:2.0:1782487585.981406:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487585.981408:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56da25600, rc 0) 00000100:00100000:2.0:1782487585.981432:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1124:294483:x1869066294328576:12345-192.168.202.21@tcp:101:touch.500 Request processed in 240us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.981440:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26975 00000100:00100000:2.0:1782487585.981445:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399509660 time 7213402572086 state 0x2 ref 0 00000100:00100000:2.0:1782487585.981466:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328832 00000100:00100000:2.0:1782487585.981470:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328832 00000100:00100000:2.0:1782487585.981484:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213399509660 time 7213402572086 state 0x0 ref 1 00000100:00100000:2.0:1782487585.981491:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213402672086 time 7213402572086 state 0x1 ref 1 00000100:00100000:2.0:1782487585.981506:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294328960 00000100:00100000:2.0:1782487585.981509:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294328960 00000100:00100000:2.0:1782487585.981519:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213402672086 time 7213402572086 state 0x1 ref 2 00000100:00100000:2.0:1782487585.981532:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213403023374 time 7213402923374 state 0x1 ref 2 00000100:00100000:2.0:1782487585.981541:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1125:294488:x1869066294328832:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.981547:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.981562:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2363:x1869066294328704:12345-192.168.202.21@tcp:2:touch.500 Request processed in 377us (471us total) trans 8589940003 rc 0/0 00000100:00100000:3.0:1782487585.981571:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16187 00000100:00100000:2.0:1782487585.981604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487585.981722:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85ca3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dad expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981763:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981774:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981785:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.981828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.981855:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329088 00000100:00100000:3.0:1782487585.981861:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329088 00000100:00100000:2.0:1782487585.981871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.981899:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1146 00010000:00010000:2.0:1782487585.981900:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981911:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.981920:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982000:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982009:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982015:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.982018:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:2362:x1869066294329088:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487585.982043:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.982056:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85ca58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dbb expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.982069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.982086:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.982096:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafc:0x0]: returning size 0 00010000:00010000:3.0:1782487585.982098:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.982104:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487585.982111:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487585.982121:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982133:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982142:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982155:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982165:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982169:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982172:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.982178:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982182:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982189:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982196:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982200:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487585.982213:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.982219:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982227:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85ca43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982240:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982247:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982252:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982254:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982271:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.982272:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982277:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982279:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329216 00010000:00010000:3.0:1782487585.982283:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982284:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329216 00010000:00010000:2.0:1782487585.982287:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982304:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213403023374 time 7213402923374 state 0x1 ref 3 00010000:00010000:2.0:1782487585.982306:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4a4c88c00) 00010000:00010000:3.0:1782487585.982309:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.982312:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.982316:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982318:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982333:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ca4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982337:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982339:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329344 00000100:00100000:1.0:1782487585.982350:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329344 00010000:00010000:3.0:1782487585.982353:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.982358:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.982361:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982365:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213403023374 time 7213402923374 state 0x1 ref 4 00010000:00010000:2.0:1782487585.982369:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85ca3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dad expref: 1131 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982377:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85ca5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982383:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329472 00010000:00010000:2.0:1782487585.982386:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dad expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982386:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329472 00010000:00010000:3.0:1782487585.982395:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982395:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105700) 00000100:00100000:1.0:1782487585.982398:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213403023374 time 7213402923374 state 0x1 ref 5 00010000:00010000:2.0:1782487585.982399:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.982402:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5476fda00, rc 0) 00010000:00010000:3.0:1782487585.982412:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982419:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213403908577 time 7213403808577 state 0x1 ref 5 00010000:00010000:3.0:1782487585.982421:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.982434:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294488:x1869066294328832:12345-192.168.202.21@tcp:101:rm.500 Request processed in 893us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.982436:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294486:x1869066294328960:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.982437:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:2.0:1782487585.982444:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26976 00010000:00010000:3.0:1782487585.982446:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982448:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.982456:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982460:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85ca6d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477db4 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982484:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487585.982489:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.982492:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982498:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85ca66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982505:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982517:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982526:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.982528:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213404018358 time 7213403918358 state 0x1 ref 4 00010000:00010000:3.0:1782487585.982533:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85ca58 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dbb expref: 1131 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982541:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.982542:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294491:x1869066294329216:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487585.982548:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.982551:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982553:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487585.982554:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.982564:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85ca58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dbb expref: 1131 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982565:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85ca82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dc2 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982565:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.982591:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07000, rc -2) 00010000:00010000:2.0:1782487585.982627:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982638:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982647:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.982657:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:2362:x1869066294329088:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 700us (829us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487585.982666:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1146 00010000:00010000:1.0:1782487585.982669:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982680:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982687:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.982706:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafd:0x0]: returning size 0 00010000:00010000:2.0:1782487585.982708:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487585.982709:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487585.982716:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.982720:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982725:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982729:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982736:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982742:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982749:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982755:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.982758:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982765:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982776:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.982779:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.982782:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982789:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85ca74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982799:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982802:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982808:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982809:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982816:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982817:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982822:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.982826:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982833:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487585.982834:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb00:0x0]: returning size 0 00000004:00200000:2.0:1782487585.982838:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.982843:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb543a0d700) 00010000:00010000:1.0:1782487585.982846:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:2.0:1782487585.982847:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982850:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982856:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85ca7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982857:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982865:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982871:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982877:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982883:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.982885:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85ca6d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477db4 expref: 1131 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982887:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982894:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982899:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477db4 expref: 1130 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982904:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.982906:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.982907:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.982909:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.982910:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982911:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00010000:00010000:2.0:1782487585.982918:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85ca89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982929:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.982939:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:190320:x1869066299219328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6840us (7000us total) trans 8589940665 rc 0/0 00010000:00010000:2.0:1782487585.982943:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982945:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294486:x1869066294328960:12345-192.168.202.21@tcp:101:rm.500 Request processed in 509us (1565us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.982955:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982957:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26977 00000100:00100000:3.0:1782487585.982960:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16185 00010000:00010000:2.0:1782487585.982965:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56d88e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487585.982969:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.982976:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982980:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213404470766 time 7213404370766 state 0x1 ref 3 00010000:00010000:2.0:1782487585.982985:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4a4c88700) 00010000:00010000:2.0:1782487585.982988:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487585.982991:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.982991:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294489:x1869066294329344:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.982997:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56d88e600/0x66475b4e8b85ca97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.982999:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487585.983000:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213404470766 time 7213404388742 state 0x0 ref 3 00010000:00010000:1.0:1782487585.983008:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85caa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dc9 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.983020:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294490:x1869066294329472:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.983029:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85ca82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc2 expref: 1131 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983031:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.983036:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983044:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983047:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cab3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dd0 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.983047:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc2 expref: 1130 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983054:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.983062:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:2.0:1782487585.983067:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487585.983072:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e9e00, rc 0) 00010000:00010000:1.0:1782487585.983083:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983090:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983097:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983100:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983114:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.983116:0:190320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491ae300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190320:1869066299219328:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1782487585.983130:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487585.983135:0:190320:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1872:0x0]-[0x240000400:0x18a1:0x0] 00010000:00010000:3.0:1782487585.983150:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983159:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983162:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983171:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983175:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983186:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.983215:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294491:x1869066294329216:12345-192.168.202.21@tcp:101:rm.500 Request processed in 663us (1599us total) trans 0 rc 0/0 00000004:00200000:1.0:1782487585.983220:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xafe:0x0]: returning size 0 00000100:00100000:2.0:1782487585.983223:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26978 00000004:00200000:1.0:1782487585.983223:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487585.983235:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983244:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983252:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983259:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983260:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983283:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983285:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983296:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.983302:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983302:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983320:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487585.983333:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xaff:0x0]: returning size 0 00010000:00010000:1.0:1782487585.983333:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.983335:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1782487585.983339:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487585.983340:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983347:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85caac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.983356:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983357:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983372:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983378:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983379:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983391:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.983396:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983398:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983410:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983414:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983418:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.983423:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.983425:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983425:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983441:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85caba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983443:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.983450:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983458:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983465:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85caa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc9 expref: 1131 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983471:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.983476:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.983477:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc9 expref: 1130 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983482:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.983484:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487585.983490:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.983494:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0da00, rc 0) 00010000:00010000:3.0:1782487585.983497:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983510:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983517:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983524:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983530:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:1.0:1782487585.983532:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294489:x1869066294329344:12345-192.168.202.21@tcp:101:rm.500 Request processed in 541us (1660us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487585.983536:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.983544:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26979 00010000:00010000:3.0:1782487585.983549:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983564:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb55a37b800) 00010000:00010000:3.0:1782487585.983567:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.983570:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983577:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983626:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cab3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd0 expref: 1130 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983641:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd0 expref: 1129 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.983648:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:3.0:1782487585.983651:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487585.983655:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7600, rc 0) 00000100:00100000:3.0:1782487585.983687:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294490:x1869066294329472:12345-192.168.202.21@tcp:101:rm.500 Request processed in 672us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487585.983699:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26980 00000100:00100000:3.0:1782487585.983704:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213404470766 time 7213404388742 state 0x2 ref 0 00000100:00100000:2.0:1782487585.984080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.984125:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329728 00000100:00100000:1.0:1782487585.984131:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329728 00000100:00100000:2.0:1782487585.984136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.984170:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5762 00000100:00100000:3.0:1782487585.984177:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329856 00000100:00100000:1.0:1782487585.984180:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294480:x1869066294329728:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487585.984183:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329856 00000100:00100000:3.0:1782487585.984240:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16188 00000100:00100000:3.0:1782487585.984252:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+118:2363:x1869066294329856:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487585.984442:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294480:x1869066294329728:12345-192.168.202.21@tcp:35:touch.500 Request processed in 263us (363us total) trans 8589956853 rc 0/0 00000100:00100000:1.0:1782487585.984451:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5762 00000100:00100000:3.0:1782487585.984465:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+119:2363:x1869066294329856:12345-192.168.202.21@tcp:2:touch.500 Request processed in 214us (328us total) trans 8589940666 rc 0/0 00000100:00100000:3.0:1782487585.984476:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16188 00000100:00100000:2.0:1782487585.985515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.985550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.985551:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294330112 00000100:00100000:3.0:1782487585.985556:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294330112 00000100:00100000:3.0:1782487585.985591:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294329984 00000100:00100000:2.0:1782487585.985593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.985594:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294329984 00000100:00100000:2.0:1782487585.985631:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294330240 00000100:00100000:2.0:1782487585.985636:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294330240 00000100:00100000:3.0:1782487585.985654:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1161 00000100:00100000:3.0:1782487585.985664:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:2363:x1869066294330112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487585.985667:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16189 00010000:00010000:3.0:1782487585.985674:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487585.985676:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2361:x1869066294330240:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.985684:0:213221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487585.985690:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cacf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc9 expref: 1131 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.985701:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1162 00010000:00010000:3.0:1782487585.985705:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487585.985709:0:213221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dd7 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.985710:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487585.985715:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:2363:x1869066294329984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487585.985734:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782487585.985738:0:213221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184a:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487585.985751:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85ca51 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dad expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.985752:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:2363:x1869066294330112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 88us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487585.985753:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.985760:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487585.985767:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1161 00010000:00010000:2.0:1782487585.985772:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 97 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.985776:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105700) 00010000:00010000:1.0:1782487585.985783:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487585.985793:0:213221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 97 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.985804:0:213221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57edff600, rc 0) 00000100:00100000:1.0:1782487585.985822:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1128:2363:x1869066294329984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.985833:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2361:x1869066294330240:12345-192.168.202.21@tcp:101:rm.500 Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.985834:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1162 00000100:00100000:2.0:1782487585.985845:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16189 00000100:00100000:2.0:1782487585.987307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487585.987345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.987378:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294330496 00000100:00100000:2.0:1782487585.987379:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.987384:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294330496 00000100:00100000:1.0:1782487585.987393:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294330752 00000100:00100000:1.0:1782487585.987400:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294330752 00000100:00100000:2.0:1782487585.987405:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294330880 00000100:00100000:2.0:1782487585.987410:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294330880 00000100:00100000:3.0:1782487585.987423:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5763 00000100:00100000:1.0:1782487585.987424:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213404470766 time 7213404388742 state 0x0 ref 1 00000100:00100000:3.0:1782487585.987434:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57ed90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294483:x1869066294330496:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487585.987440:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213404488742 time 7213404388742 state 0x1 ref 1 00000100:00100000:2.0:1782487585.987447:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1163 00000100:00100000:2.0:1782487585.987457:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:2361:x1869066294330880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487585.987471:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487585.987486:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213404488742 time 7213408875630 state 0x0 ref 1 00010000:00010000:2.0:1782487585.987489:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ca90 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477db4 expref: 1130 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.987503:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294487:x1869066294330752:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487585.987508:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487585.987514:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.987527:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.987541:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cae4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dde expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.987559:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:2361:x1869066294330880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.987568:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1163 00000100:00100000:2.0:1782487585.987664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.987691:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294331008 00000100:00100000:1.0:1782487585.987696:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294331008 00000100:00100000:3.0:1782487585.987782:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57ed90c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294483:x1869066294330496:12345-192.168.202.21@tcp:35:touch.500 Request processed in 293us (421us total) trans 8589956854 rc 0/0 00000100:00100000:3.0:1782487585.987791:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5763 00000100:00100000:2.0:1782487585.987798:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16190 00000100:00100000:2.0:1782487585.987808:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+119:2363:x1869066294331008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487585.987816:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487585.987829:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477de5 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487585.987849:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1870:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487585.987861:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487585.987865:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487585.987873:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 120 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.987889:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 120 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.987890:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.987911:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56d88e600, rc 0) 00010000:00010000:1.0:1782487585.987913:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.987925:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.987933:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2363:x1869066294331008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 125us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487585.987939:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16190 00010000:00010000:1.0:1782487585.987942:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.987951:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.987959:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487585.988499:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184c:0x0], index 1: 0 00010000:00010000:1.0:1782487585.988699:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb00 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988710:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988718:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988884:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988893:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988900:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988907:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.988912:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988920:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988932:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487585.988935:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.988940:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.988947:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85caf2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487585.988961:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ede21dd reply state 000000005a0505b5 transno 8589956855 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.988969:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.988997:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cae4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dde expref: 1131 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989012:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dde expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989093:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:1.0:1782487585.989096:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487585.989099:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00000100:00100000:1.0:1782487585.989150:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294487:x1869066294330752:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1650us (1804us total) trans 8589956855 rc 0/0 00000100:00100000:1.0:1782487585.989159:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26981 00000100:00100000:1.0:1782487585.989167:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213404488742 time 7213408875630 state 0x2 ref 0 00010000:00010000:1.0:1782487585.989892:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989901:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989908:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989914:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.989918:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989926:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989938:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb543a0de00) 00010000:00010000:1.0:1782487585.989941:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.989944:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.989956:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85caf9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.991009:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.991060:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294331264 00000100:00100000:1.0:1782487585.991068:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294331264 00000100:00100000:1.0:1782487585.991099:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213404488742 time 7213408875630 state 0x0 ref 1 00000100:00100000:2.0:1782487585.991100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487585.991114:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213408975630 time 7213408875630 state 0x1 ref 1 00000100:00100000:1.0:1782487585.991137:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294331520 00000100:00100000:1.0:1782487585.991141:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294331520 00000100:00100000:1.0:1782487585.991154:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213408975630 time 7213408875630 state 0x1 ref 2 00000100:00100000:3.0:1782487585.991172:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213412659488 time 7213412559488 state 0x1 ref 2 00000100:00100000:1.0:1782487585.991184:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213412659488 time 7213412573352 state 0x0 ref 2 00000100:00100000:3.0:1782487585.991191:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294487:x1869066294331264:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487585.991201:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294482:x1869066294331520:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.991251:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487585.991251:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.991272:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb00 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dde expref: 1131 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991273:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85c836 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cf7 expref: 1131 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991304:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85c748 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xafb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477caa expref: 1130 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991316:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb4c5187900) 00010000:00010000:1.0:1782487585.991328:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.991333:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:3.0:1782487585.991345:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487585.991347:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991365:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991374:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991389:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991397:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.991402:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991405:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.991422:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.991433:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991540:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.991544:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d25f882 reply state 0000000071f50eb9 transno 8589956856 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.991554:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.991555:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487585.991566:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.991648:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294487:x1869066294331264:12345-192.168.202.21@tcp:36:touch.500 Request processed in 462us (642us total) trans 8589956856 rc 0/0 00000100:00100000:3.0:1782487585.991657:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26982 00000040:00080000:1.0:1782487585.992113:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2540, 64 off170752 00010000:00010000:1.0:1782487585.992191:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992201:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992225:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992233:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992240:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992246:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992264:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487585.992276:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992283:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992290:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992297:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.992302:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992310:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992320:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:1.0:1782487585.992323:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487585.992326:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992336:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cb23 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xafb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992353:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992360:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992366:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992372:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.992376:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992383:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.992384:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992392:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992398:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.992401:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.992402:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.992407:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992409:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992428:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992428:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cb0e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992447:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafb:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:3.0:1782487585.992451:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:1.0:1782487585.992451:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d00b7017 reply state 00000000ca12d5f5 transno 8589956857 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992457:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.992463:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487585.992468:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cb2a lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.992491:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.992492:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.992493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.992495:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487585.992502:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.992505:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992514:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992519:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.992524:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992530:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992540:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb55a37b800) 00010000:00010000:1.0:1782487585.992543:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.992546:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992552:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cb1c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487585.992631:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294482:x1869066294331520:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1433us (1533us total) trans 8589956857 rc 0/0 00000100:00100000:1.0:1782487585.992639:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26983 00000100:00100000:1.0:1782487585.992645:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213412659488 time 7213412573352 state 0x2 ref 0 00000100:00100000:1.0:1782487585.992667:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294331648 00000100:00100000:1.0:1782487585.992671:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294331648 00000100:00100000:1.0:1782487585.992683:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213412659488 time 7213412573352 state 0x0 ref 1 00000100:00100000:1.0:1782487585.992690:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213412673352 time 7213412573352 state 0x1 ref 1 00000100:00100000:1.0:1782487585.992709:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213412673352 time 7213414101028 state 0x0 ref 1 00000100:00100000:1.0:1782487585.992718:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294487:x1869066294331648:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487585.992726:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487585.992736:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85cb31 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dec expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992758:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85cb31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dec expref: 1131 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992765:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85cb31 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dec expref: 1131 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.992776:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:1.0:1782487585.992778:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487585.992780:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196ce00, rc 0) 00000100:00100000:1.0:1782487585.992803:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294487:x1869066294331648:12345-192.168.202.21@tcp:101:touch.500 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487585.992808:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26984 00000100:00100000:1.0:1782487585.992812:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213412673352 time 7213414101028 state 0x2 ref 0 00010000:00010000:1.0:1782487585.994529:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.994534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.994543:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.994550:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.994557:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.994561:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.994568:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.994580:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb543a0d800) 00010000:00010000:1.0:1782487585.994583:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782487585.994698:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294331904 00000100:00100000:3.0:1782487585.994704:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294331904 00000100:00100000:3.0:1782487585.994726:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213412673352 time 7213414101028 state 0x0 ref 1 00000100:00100000:3.0:1782487585.994736:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213414201028 time 7213414101028 state 0x1 ref 1 00010000:00010000:1.0:1782487585.994758:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.994764:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213414201028 time 7213416153523 state 0x0 ref 1 00010000:00010000:1.0:1782487585.994770:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cb15 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.994780:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294473:x1869066294331904:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487585.994817:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487585.994835:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85c805 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce9 expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994857:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85c588 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c64 expref: 1129 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994869:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487585.994879:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487585.994894:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994905:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994915:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994931:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994939:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.994947:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995043:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995054:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995062:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487585.995527:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2541, 64 off170816 00010000:00010000:3.0:1782487585.995598:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995691:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995701:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995710:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995717:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995724:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995798:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487585.995814:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995821:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995832:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995838:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.995842:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995850:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995861:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb55a37ba00) 00000100:00100000:2.0:1782487585.995863:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487585.995866:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487585.995871:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995880:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cb46 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995936:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995944:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995950:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995957:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487585.995961:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995972:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995984:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487585.995987:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487585.995991:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487585.995997:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cb38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487585.996010:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff43b4d8 reply state 0000000024f9f7a5 transno 8589956858 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.996018:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487585.996050:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294332032 00000100:00100000:3.0:1782487585.996054:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294332032 00000100:00100000:3.0:1782487585.996094:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16191 00000100:00100000:3.0:1782487585.996105:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2360:x1869066294332032:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:1.0:1782487585.996260:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487585.996266:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.996272:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487585.996276:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.996282:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.996292:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaf7:0x0].0x0 (ffff9cb55a37ba00) 00010000:00010000:1.0:1782487585.996295:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487585.996297:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.996302:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cb4d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.996317:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.996320:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487585.996323:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487585.996341:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2360:x1869066294332032:12345-192.168.202.21@tcp:2:touch.500 Request processed in 237us (479us total) trans 8589940004 rc 0/0 00000100:00100000:3.0:1782487585.996351:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16191 00000100:00100000:3.0:1782487585.996392:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294473:x1869066294331904:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1616us (1863us total) trans 8589956858 rc 0/0 00000100:00100000:3.0:1782487585.996400:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26985 00000100:00100000:3.0:1782487585.996406:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213414201028 time 7213416153523 state 0x2 ref 0 00000100:00100000:2.0:1782487585.999443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487585.999448:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.999459:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.999467:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.999473:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487585.999478:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.999484:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487585.999486:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294332288 00000100:00100000:3.0:1782487585.999492:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294332288 00010000:00010000:1.0:1782487585.999494:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb55a37b200) 00010000:00010000:1.0:1782487585.999498:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487585.999500:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487585.999505:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cb3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487585.999514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487585.999546:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5764 00000100:00100000:3.0:1782487585.999557:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294487:x1869066294332288:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487585.999834:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294332544 00000100:00100000:2.0:1782487585.999839:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294332544 00000100:00100000:2.0:1782487585.999864:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213414201028 time 7213416153523 state 0x0 ref 1 00000100:00100000:2.0:1782487585.999875:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213416253523 time 7213416153523 state 0x1 ref 1 00000100:00100000:3.0:1782487585.999880:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294487:x1869066294332288:12345-192.168.202.21@tcp:35:touch.500 Request processed in 324us (438us total) trans 8589956859 rc 0/0 00000100:00100000:3.0:1782487585.999888:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5764 00000100:00100000:2.0:1782487585.999898:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213416253523 time 7213421287718 state 0x0 ref 1 00000100:00100000:2.0:1782487585.999909:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294488:x1869066294332544:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487585.999934:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487585.999952:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85c883 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d05 expref: 1130 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.999975:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85c7aa lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xafc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cd4 expref: 1129 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487585.999988:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb54b105700) 00010000:00010000:2.0:1782487585.999998:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.000012:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000022:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000032:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000047:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000055:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000063:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000158:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000165:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000171:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.000688:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2535, 64 off170432 00010000:00010000:2.0:1782487586.000762:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000771:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000781:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000789:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000796:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000803:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000823:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.000836:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000846:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.000848:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000855:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000857:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000873:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.000874:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.000877:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000880:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000886:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000900:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.000903:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000905:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.000911:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000918:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafc:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.000920:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cb69 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000924:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.000930:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000938:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb62 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xafc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.000938:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.000943:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.000949:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.000966:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000974:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000980:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000986:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.000990:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.000996:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.001005:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.001008:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.001012:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.001018:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.001031:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1d48f63 reply state 00000000ff5e4c3d transno 8589956860 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.001039:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.001100:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294488:x1869066294332544:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1192us (1589us total) trans 8589956860 rc 0/0 00000100:00100000:2.0:1782487586.001109:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26986 00000100:00100000:2.0:1782487586.001114:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213416253523 time 7213421287718 state 0x2 ref 0 00010000:00010000:1.0:1782487586.002454:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.002466:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.002473:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.002484:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.002489:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.002493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.002501:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.002515:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4a4c88d00) 00010000:00010000:1.0:1782487586.002519:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.002524:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.002530:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cb5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.002714:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294332800 00000100:00100000:3.0:1782487586.002721:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294332800 00000100:00100000:3.0:1782487586.002743:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213416253523 time 7213421287718 state 0x0 ref 1 00000100:00100000:3.0:1782487586.002753:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213421387718 time 7213421287718 state 0x1 ref 1 00000100:00100000:3.0:1782487586.002777:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213421387718 time 7213424167921 state 0x0 ref 1 00000100:00100000:3.0:1782487586.002791:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294489:x1869066294332800:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487586.002822:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487586.002840:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85c89f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d0c expref: 1129 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002861:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85c83d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xafe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d1a expref: 1128 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002874:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487586.002884:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.002899:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002911:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002921:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002934:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002941:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.002949:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003303:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003313:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003321:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.003851:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2536, 64 off170496 00010000:00010000:3.0:1782487586.003908:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003915:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003921:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003927:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003932:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003938:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003957:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.003972:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003980:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.003980:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.003989:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.003990:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004005:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.004008:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.004009:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.004015:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.004023:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004024:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.004040:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb55a37bf00) 00010000:00010000:1.0:1782487586.004044:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.004047:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004051:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafe:0x0].0x0 (ffff9cb55a37bf00) 00010000:00010000:3.0:1782487586.004057:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.004057:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cb85 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004062:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004067:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cb7e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xafe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.004080:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.004084:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.004087:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.004093:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004098:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004102:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004106:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.004109:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004113:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004119:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.004121:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.004123:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.004127:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cb70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.004135:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f39c7ba reply state 00000000acc75e35 transno 8589956861 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.004140:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.004186:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294489:x1869066294332800:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1399us (1699us total) trans 8589956861 rc 0/0 00000100:00100000:3.0:1782487586.004196:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26987 00000100:00100000:3.0:1782487586.004200:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213421387718 time 7213424167921 state 0x2 ref 0 00010000:00010000:1.0:1782487586.008546:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008568:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008576:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008583:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.008588:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008597:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008633:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb55a37b100) 00010000:00010000:1.0:1782487586.008636:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.008639:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.008644:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85cb77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.009685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.009728:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333056 00000100:00100000:3.0:1782487586.009736:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333056 00000100:00100000:2.0:1782487586.010256:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213421387718 time 7213424167921 state 0x0 ref 1 00000100:00100000:2.0:1782487586.010267:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213424267921 time 7213424167921 state 0x1 ref 1 00000100:00100000:2.0:1782487586.010293:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213424267921 time 7213431683208 state 0x0 ref 1 00000100:00100000:2.0:1782487586.010308:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1128:294486:x1869066294333056:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.010354:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.010372:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85c867 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cfe expref: 1128 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010389:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85c7d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xafd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ce2 expref: 1127 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010399:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb54b105300) 00010000:00010000:2.0:1782487586.010407:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.010424:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010437:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010446:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010458:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010466:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010472:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010563:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010568:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010573:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.010926:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2542, 64 off170880 00010000:00010000:2.0:1782487586.010983:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.010993:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011000:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011007:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011013:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011018:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011038:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.011052:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011059:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011069:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011075:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.011076:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.011083:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011085:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011096:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011098:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.011104:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011110:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb4a4c88d00) 00010000:00010000:2.0:1782487586.011114:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.011124:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011125:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011141:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71a00/0x66475b4e8b85cb9a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xafd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011147:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xafd:0x0].0x0 (ffff9cb4a4c88d00) 00010000:00010000:3.0:1782487586.011151:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.011155:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011158:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011166:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cba1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xafd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011169:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011182:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011188:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.011191:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.011192:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.011195:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.011198:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.011219:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011227:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.011229:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.011233:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.011238:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71000/0x66475b4e8b85cb8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.011248:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d85736aa reply state 00000000e9fcd375 transno 8589956862 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.011256:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.011315:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1128:294486:x1869066294333056:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1009us (1633us total) trans 8589956862 rc 0/0 00000100:00100000:2.0:1782487586.011325:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26988 00000100:00100000:2.0:1782487586.011330:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213424267921 time 7213431683208 state 0x2 ref 0 00010000:00010000:1.0:1782487586.012007:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012015:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012020:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012024:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.012027:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012031:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012039:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.012042:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.012044:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.012048:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cb93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.013394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.013460:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333312 00000100:00100000:1.0:1782487586.013468:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333312 00000100:00100000:1.0:1782487586.013493:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213424267921 time 7213431683208 state 0x0 ref 1 00000100:00100000:1.0:1782487586.013504:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213431783208 time 7213431683208 state 0x1 ref 1 00000100:00100000:1.0:1782487586.013545:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213431783208 time 7213434934995 state 0x0 ref 1 00000100:00100000:1.0:1782487586.013558:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294491:x1869066294333312:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.013590:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.013604:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85ca9e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dc2 expref: 1127 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013639:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85c9a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb00:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d83 expref: 1126 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013649:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:1.0:1782487586.013656:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.013674:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013682:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013694:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013705:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013710:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013714:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013797:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013803:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.013818:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.014150:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2537, 64 off170560 00010000:00010000:1.0:1782487586.014223:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014232:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014239:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014247:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014253:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014260:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014277:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.014303:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.014309:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014315:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.014318:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014328:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014349:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487586.014352:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.014356:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014360:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cbbd lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb00:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014370:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.014372:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.014374:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.014384:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014389:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014393:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014397:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.014399:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014403:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014410:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb00:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487586.014413:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.014415:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014419:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cbb6 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb00:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014434:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014438:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014443:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014449:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.014453:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014460:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014470:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.014473:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.014476:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.014483:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cba8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.014494:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096f6d912 reply state 000000003b7afff8 transno 8589956863 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.014503:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.014561:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294491:x1869066294333312:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1005us (1170us total) trans 8589956863 rc 0/0 00000100:00100000:1.0:1782487586.014568:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26989 00000100:00100000:1.0:1782487586.014573:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213431783208 time 7213434934995 state 0x2 ref 0 00010000:00010000:1.0:1782487586.015755:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015765:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015772:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015778:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.015782:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015789:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015800:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487586.015813:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.015818:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.015824:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85cbaf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.015961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.016003:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333440 00000100:00100000:1.0:1782487586.016008:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333440 00000100:00100000:1.0:1782487586.016024:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213431783208 time 7213434934995 state 0x0 ref 1 00000100:00100000:1.0:1782487586.016034:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213435034995 time 7213434934995 state 0x1 ref 1 00000100:00100000:1.0:1782487586.016060:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213435034995 time 7213437450343 state 0x0 ref 1 00000100:00100000:1.0:1782487586.016072:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1126:294493:x1869066294333440:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.016085:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.016094:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cbc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477df3 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016127:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016134:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016141:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016150:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016163:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016172:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.016259:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016266:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.016276:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.016308:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb02:0x0]: returning size 0 00000004:00200000:1.0:1782487586.016312:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.016327:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016346:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333568 00010000:00010000:1.0:1782487586.016349:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016350:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333568 00010000:00010000:1.0:1782487586.016362:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016369:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016370:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213437550343 time 7213437450343 state 0x1 ref 2 00010000:00010000:1.0:1782487586.016384:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016391:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333696 00010000:00010000:1.0:1782487586.016391:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:3.0:1782487586.016395:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333696 00010000:00010000:1.0:1782487586.016398:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016407:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016408:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213437550343 time 7213437450343 state 0x1 ref 3 00010000:00010000:1.0:1782487586.016427:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:3.0:1782487586.016428:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213437919177 time 7213437819177 state 0x1 ref 3 00010000:00010000:1.0:1782487586.016432:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.016437:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.016440:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294494:x1869066294333568:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.016450:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cbcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016454:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.016465:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016467:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cbe0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477dfa expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016483:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016491:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016496:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.016499:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016506:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016515:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487586.016518:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.016522:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016528:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cbd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016563:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016570:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cbc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477df3 expref: 1131 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016574:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016588:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016594:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477df3 expref: 1130 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016600:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016623:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4a4c88a00) 00010000:00010000:1.0:1782487586.016633:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.016634:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016637:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00010000:00010000:3.0:1782487586.016647:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.016676:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294493:x1869066294333440:12345-192.168.202.21@tcp:101:rm.500 Request processed in 605us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.016695:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26990 00010000:00010000:3.0:1782487586.016718:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.016722:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213437919177 time 7213438111323 state 0x0 ref 2 00010000:00010000:3.0:1782487586.016729:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016736:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.016741:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294492:x1869066294333696:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.016752:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1782487586.016754:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb03:0x0]: returning size 0 00000004:00200000:3.0:1782487586.016757:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.016763:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cbfc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e01 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.016770:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016780:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016788:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016795:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016796:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016817:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016820:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016830:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016848:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016857:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016858:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.016864:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016869:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016871:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016893:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.016897:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.016901:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016908:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cbe7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016921:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016928:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016935:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016942:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.016947:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016954:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016961:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016964:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb55a37bf00) 00010000:00010000:3.0:1782487586.016972:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.016976:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016976:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.016993:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cbee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.016995:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.017015:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb01:0x0]: returning size 0 00010000:00010000:3.0:1782487586.017018:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cbe0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dfa expref: 1131 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.017020:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.017033:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dfa expref: 1130 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.017035:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.017040:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:3.0:1782487586.017045:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.017048:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551526e00, rc 0) 00010000:00010000:1.0:1782487586.017052:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017062:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017069:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.017070:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294494:x1869066294333568:12345-192.168.202.21@tcp:101:rm.500 Request processed in 632us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.017085:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26991 00010000:00010000:1.0:1782487586.017092:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017096:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.017099:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017104:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017113:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.017115:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.017117:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017122:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85cc03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.017132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.017132:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017140:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017144:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017149:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474401600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.017153:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017164:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017174:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb44297d300) 00010000:00010000:1.0:1782487586.017177:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.017181:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017187:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85cc0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.017221:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333824 00010000:00010000:1.0:1782487586.017224:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85cbfc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e01 expref: 1130 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.017227:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333824 00010000:00010000:1.0:1782487586.017240:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e01 expref: 1130 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017245:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487586.017249:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1782487586.017250:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438211323 time 7213438111323 state 0x1 ref 2 00010000:00010000:1.0:1782487586.017251:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e800, rc 0) 00000100:00100000:1.0:1782487586.017285:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294492:x1869066294333696:12345-192.168.202.21@tcp:101:rm.500 Request processed in 549us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.017302:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26992 00000100:00100000:1.0:1782487586.017323:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438211323 time 7213438713392 state 0x0 ref 1 00000100:00100000:1.0:1782487586.017335:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294495:x1869066294333824:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.017343:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.017364:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85cc18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e08 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017395:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017402:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017408:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017417:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017422:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017427:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017482:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017490:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017497:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.017513:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb04:0x0]: returning size 0 00000004:00200000:1.0:1782487586.017516:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.017525:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017534:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017542:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017549:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017555:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017560:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.017564:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017571:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017581:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.017584:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.017588:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017593:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85cc1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017621:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017628:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017635:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017640:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.017644:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017651:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017660:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.017664:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.017667:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017673:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cc26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017702:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85cc18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e08 expref: 1131 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017716:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e08 expref: 1130 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.017723:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:1.0:1782487586.017726:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.017729:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578dea800, rc 0) 00000100:00100000:1.0:1782487586.017754:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294495:x1869066294333824:12345-192.168.202.21@tcp:101:rm.500 Request processed in 420us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.017764:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26993 00000100:00100000:1.0:1782487586.017768:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438211323 time 7213438713392 state 0x2 ref 0 00000100:00100000:3.0:1782487586.018532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.018575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.018627:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294334080 00000100:00100000:1.0:1782487586.018631:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294334080 00000100:00100000:1.0:1782487586.018661:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294333952 00000100:00100000:1.0:1782487586.018664:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294333952 00000100:00100000:2.0:1782487586.020263:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16192 00000100:00100000:2.0:1782487586.020276:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2361:x1869066294334080:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.020288:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.020292:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16193 00000100:00100000:1.0:1782487586.020305:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2363:x1869066294333952:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.020314:0:190930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.020316:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e0f expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.020345:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1872:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.020361:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.020366:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.020374:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 121 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.020389:0:190930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e16 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.020390:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 121 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.020414:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71000, rc 0) 00002000:00010000:1.0:1782487586.020420:0:190930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184b:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.020432:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.020435:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.020441:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 99 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.020453:0:190930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 99 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.020454:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2361:x1869066294334080:12345-192.168.202.21@tcp:101:rm.500 Request processed in 180us (1925us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487586.020468:0:190930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deaa00, rc 0) 00000100:00100000:2.0:1782487586.020470:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16192 00000100:00100000:1.0:1782487586.020493:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2363:x1869066294333952:12345-192.168.202.21@tcp:101:rm.500 Request processed in 192us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.020502:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16193 00000100:00100000:3.0:1782487586.020781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.020823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.020832:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294334208 00000100:00100000:2.0:1782487586.020838:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294334208 00000100:00100000:1.0:1782487586.020845:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294334336 00000100:00100000:1.0:1782487586.020850:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294334336 00000100:00100000:3.0:1782487586.020855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.020879:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16194 00000100:00100000:3.0:1782487586.020885:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294334592 00000100:00100000:1.0:1782487586.020886:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16195 00000100:00100000:3.0:1782487586.020891:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294334592 00000100:00100000:2.0:1782487586.020892:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2362:x1869066294334208:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487586.020899:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2360:x1869066294334336:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.020901:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.020911:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438211323 time 7213438713392 state 0x0 ref 1 00010000:00010000:2.0:1782487586.020913:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e1d expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.020915:0:213220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.020922:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438813392 time 7213438713392 state 0x1 ref 1 00010000:00010000:1.0:1782487586.020929:0:213220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e24 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.020935:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1871:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:3.0:1782487586.020943:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438813392 time 7213442333734 state 0x0 ref 1 00002000:00010000:1.0:1782487586.020944:0:213220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184c:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.020946:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.020956:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.020958:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.020963:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487586.020965:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294490:x1869066294334592:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.020965:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 122 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.020970:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 100 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.020982:0:213220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 100 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021000:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.021004:0:213220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44fb75e00, rc 0) 00010000:00010000:2.0:1782487586.021006:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 122 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021018:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cad6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd0 expref: 1130 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.021018:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71a00, rc 0) 00010000:00010000:3.0:1782487586.021040:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85c91d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xaff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d6e expref: 1129 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.021043:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2360:x1869066294334336:12345-192.168.202.21@tcp:101:rm.500 Request processed in 144us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.021047:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2362:x1869066294334208:12345-192.168.202.21@tcp:101:rm.500 Request processed in 157us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.021061:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16195 00010000:00010000:3.0:1782487586.021062:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb4c9e2f900) 00000100:00100000:2.0:1782487586.021069:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16194 00010000:00010000:3.0:1782487586.021071:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.021123:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021131:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021138:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021147:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021152:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021157:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021416:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021423:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.021431:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.022027:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2543, 64 off170944 00010000:00010000:3.0:1782487586.022111:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022122:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022131:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022139:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022146:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022153:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022171:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.022187:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022195:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.022198:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022211:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022223:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022226:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.022234:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022235:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.022242:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022248:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022251:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022267:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb55a37ba00) 00010000:00010000:1.0:1782487586.022272:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.022277:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022281:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xaff:0x0].0x0 (ffff9cb55a37ba00) 00010000:00010000:1.0:1782487586.022284:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cc65 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xaff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022286:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.022292:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022300:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cc5e lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xaff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.022301:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.022306:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.022310:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.022323:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022331:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022337:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022343:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.022347:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022354:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022364:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.022367:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.022371:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.022377:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cc50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.022388:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fdbffcc reply state 000000005d5af35d transno 8589956864 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.022397:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.022439:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294490:x1869066294334592:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1479us (1586us total) trans 8589956864 rc 0/0 00000100:00100000:3.0:1782487586.022446:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26994 00000100:00100000:3.0:1782487586.022450:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438813392 time 7213442333734 state 0x2 ref 0 00010000:00010000:1.0:1782487586.023404:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023413:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023420:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023426:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.023430:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023437:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023448:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb55a37b200) 00010000:00010000:1.0:1782487586.023452:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.023455:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.023461:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cc57 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.023882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.023930:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294334848 00000100:00100000:1.0:1782487586.023936:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294334848 00000100:00100000:1.0:1782487586.023955:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213438813392 time 7213442333734 state 0x0 ref 1 00000100:00100000:1.0:1782487586.023966:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213442433734 time 7213442333734 state 0x1 ref 1 00000100:00100000:1.0:1782487586.023989:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213442433734 time 7213445379583 state 0x0 ref 1 00000100:00100000:1.0:1782487586.024002:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294492:x1869066294334848:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.024031:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.024047:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85cc11 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e01 expref: 1129 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024068:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85c9da lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb01:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d91 expref: 1128 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024079:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487586.024088:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.024100:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024110:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024124:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024136:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024144:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024152:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024245:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024254:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024262:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.024697:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2544, 64 off171008 00010000:00010000:1.0:1782487586.024767:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024779:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024786:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024794:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024801:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024807:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024825:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.024838:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024841:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.024848:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024849:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024864:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024865:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.024871:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024875:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.024882:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024885:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024898:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024902:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:3.0:1782487586.024906:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.024908:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024913:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cc81 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb01:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024918:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb01:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:1.0:1782487586.024922:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.024924:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.024926:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.024928:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.024932:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.024938:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85cc7a lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb01:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024964:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024971:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024976:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024980:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.024983:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024990:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.024999:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.025002:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.025005:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025012:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85cc6c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.025024:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f051834 reply state 00000000a584d0ef transno 8589956865 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.025032:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.025073:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294492:x1869066294334848:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1075us (1192us total) trans 8589956865 rc 0/0 00000100:00100000:1.0:1782487586.025082:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26995 00000100:00100000:1.0:1782487586.025086:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213442433734 time 7213445379583 state 0x2 ref 0 00010000:00010000:1.0:1782487586.025742:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025751:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025758:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025764:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.025769:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025776:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025787:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.025790:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.025794:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.025800:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85cc73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.026260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.026317:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294335104 00000100:00100000:2.0:1782487586.026323:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294335104 00000100:00100000:2.0:1782487586.026346:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213442433734 time 7213445379583 state 0x0 ref 1 00000100:00100000:2.0:1782487586.026357:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213445479583 time 7213445379583 state 0x1 ref 1 00000100:00100000:2.0:1782487586.026388:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213445479583 time 7213447778171 state 0x0 ref 1 00000100:00100000:2.0:1782487586.026401:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1128:294494:x1869066294335104:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.026429:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.026443:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cbf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dfa expref: 1128 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026459:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85ca35 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb03:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477da6 expref: 1127 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026472:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:2.0:1782487586.026484:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.026498:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026517:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026530:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026545:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026553:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026561:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026673:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026681:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.026690:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.027134:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2545, 64 off171072 00010000:00010000:2.0:1782487586.027214:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027223:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027232:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027239:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027247:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027253:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027274:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.027286:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027294:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027296:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.027305:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027306:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027322:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.027325:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.027331:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027333:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027348:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027349:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027368:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.027371:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.027374:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027378:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85cc96 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb03:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027381:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb03:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:3.0:1782487586.027388:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.027393:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027399:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027401:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85cc9d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb03:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027411:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027417:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027422:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.027424:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027429:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.027429:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.027436:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.027439:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.027441:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.027442:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.027445:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.027449:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85cc88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.027460:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016d87b64 reply state 0000000087d2e8e8 transno 8589956866 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.027468:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.027522:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1128:294494:x1869066294335104:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1122us (1261us total) trans 8589956866 rc 0/0 00000100:00100000:2.0:1782487586.027534:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26996 00000100:00100000:2.0:1782487586.027539:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213445479583 time 7213447778171 state 0x2 ref 0 00010000:00010000:1.0:1782487586.028131:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028155:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028162:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028167:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.028171:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028177:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028187:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.028190:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.028193:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.028199:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85cc8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.028552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.028599:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294335360 00000100:00100000:2.0:1782487586.028626:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294335360 00000100:00100000:2.0:1782487586.028650:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213445479583 time 7213447778171 state 0x0 ref 1 00000100:00100000:2.0:1782487586.028661:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213447878171 time 7213447778171 state 0x1 ref 1 00000100:00100000:2.0:1782487586.028686:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213447878171 time 7213450075995 state 0x0 ref 1 00000100:00100000:2.0:1782487586.028698:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294493:x1869066294335360:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.028727:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.028744:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85cbd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477df3 expref: 1127 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028766:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85ca0b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb02:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d9f expref: 1126 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028776:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4a4c88a00) 00010000:00010000:2.0:1782487586.028786:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.028800:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028809:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028818:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028833:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028840:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028848:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028928:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028934:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.028940:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.029350:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2538, 64 off170624 00010000:00010000:2.0:1782487586.029421:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029428:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029435:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029440:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029444:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029449:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029468:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.029481:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029488:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029491:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.029496:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029498:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029515:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.029521:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.029524:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029529:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029534:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029553:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029557:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:2.0:1782487586.029562:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.029566:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029570:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb02:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:2.0:1782487586.029571:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85ccb2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb02:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029575:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.029581:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029587:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb02:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029589:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029600:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029603:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.029624:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.029625:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.029626:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.029634:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.029638:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029645:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029657:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.029660:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.029663:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.029668:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cca4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.029681:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa77130a reply state 000000003685a492 transno 8589956867 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.029689:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.029745:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294493:x1869066294335360:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1049us (1193us total) trans 8589956867 rc 0/0 00000100:00100000:2.0:1782487586.029754:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26997 00000100:00100000:2.0:1782487586.029759:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213447878171 time 7213450075995 state 0x2 ref 0 00010000:00010000:1.0:1782487586.030306:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030315:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030322:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030328:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.030331:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030338:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030346:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4c9e2fc00) 00010000:00010000:1.0:1782487586.030349:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.030353:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.030359:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.030789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.030860:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294335616 00000100:00100000:3.0:1782487586.030867:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294335616 00000100:00100000:3.0:1782487586.030890:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213447878171 time 7213450075995 state 0x0 ref 1 00000100:00100000:3.0:1782487586.030901:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213450175995 time 7213450075995 state 0x1 ref 1 00000100:00100000:3.0:1782487586.030924:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213450175995 time 7213452315328 state 0x0 ref 1 00000100:00100000:3.0:1782487586.030934:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1126:294495:x1869066294335616:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487586.030967:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487586.030983:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cc2d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e08 expref: 1126 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031005:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85cb31 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb04:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dec expref: 1125 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031063:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb57f753100) 00010000:00010000:3.0:1782487586.031072:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.031084:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031093:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031099:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031117:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031123:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031128:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031223:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031232:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031239:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.031683:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2539, 64 off170688 00010000:00010000:3.0:1782487586.031756:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031767:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031775:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031783:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031791:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031798:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031816:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.031830:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031833:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.031839:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031841:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031853:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031856:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.031861:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031865:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.031871:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031872:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031890:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb55a37bf00) 00010000:00010000:3.0:1782487586.031891:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031896:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.031901:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031907:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb04:0x0].0x0 (ffff9cb55a37bf00) 00010000:00010000:1.0:1782487586.031909:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ccd5 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb04:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031913:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.031918:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031923:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.031926:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccce lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb04:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.031926:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.031929:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.031947:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031955:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031959:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031962:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.031965:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031969:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031978:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.031981:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.031984:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.031990:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccc0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.032000:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb4a4a0e reply state 00000000c21d0800 transno 8589956868 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.032009:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.032066:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1126:294495:x1869066294335616:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1133us (1277us total) trans 8589956868 rc 0/0 00000100:00100000:3.0:1782487586.032073:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26998 00000100:00100000:3.0:1782487586.032078:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213450175995 time 7213452315328 state 0x2 ref 0 00010000:00010000:1.0:1782487586.032647:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032660:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032667:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032672:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.032675:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032682:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032699:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb55a37ba00) 00010000:00010000:1.0:1782487586.032702:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.032705:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.032712:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85ccc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.053751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.053814:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294335872 00000100:00100000:3.0:1782487586.053862:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294335872 00000100:00100000:3.0:1782487586.053898:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213450175995 time 7213452315328 state 0x0 ref 1 00000100:00100000:3.0:1782487586.053911:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213452415328 time 7213452315328 state 0x1 ref 1 00000100:00100000:3.0:1782487586.053948:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213452415328 time 7213475336937 state 0x0 ref 1 00000100:00100000:3.0:1782487586.053962:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+670:294503:x1869066294335872:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.053994:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.054014:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccdc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e2b expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054157:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054172:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054183:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054200:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054222:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.054230:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.055171:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1873:0x0], index 0: 0 00010000:00010000:2.0:1782487586.055404:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055416:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055425:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055459:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055466:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055474:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055478:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.055482:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055487:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055497:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.055499:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.055502:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055507:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cce3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.055520:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c7ca622 reply state 00000000a16caac0 transno 8589956869 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.055526:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.055551:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85ccdc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e2b expref: 673 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055562:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e2b expref: 672 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.055568:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.055570:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.055572:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00000100:00100000:2.0:1782487586.055678:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+673:294503:x1869066294335872:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1719us (1935us total) trans 8589956869 rc 0/0 00000100:00100000:2.0:1782487586.055686:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 26999 00000100:00100000:2.0:1782487586.055691:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213452415328 time 7213475336937 state 0x2 ref 0 00010000:00010000:1.0:1782487586.058842:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058855:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058864:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058875:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.058879:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058886:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058898:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb55a37bf00) 00010000:00010000:1.0:1782487586.058900:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.058904:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.058910:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85ccea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.059940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.059975:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294336128 00000100:00100000:2.0:1782487586.059983:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294336128 00000100:00100000:2.0:1782487586.060011:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213452415328 time 7213475336937 state 0x0 ref 1 00000100:00100000:2.0:1782487586.060021:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213475436937 time 7213475336937 state 0x1 ref 1 00000100:00100000:2.0:1782487586.060042:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213475436937 time 7213481432640 state 0x0 ref 1 00000100:00100000:2.0:1782487586.060051:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+672:294503:x1869066294336128:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.060101:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.060120:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85ccf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e2b expref: 672 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.060136:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.060147:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.060192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.060212:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.060230:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.060242:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.060290:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294336384 00000100:00100000:3.0:1782487586.060296:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294336384 00000100:00100000:3.0:1782487586.060328:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481532640 time 7213481432640 state 0x1 ref 2 00000004:00010000:2.0:1782487586.060354:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c0098be reply state 00000000768e4964 transno 8589956870 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.060358:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481532640 time 7213481747167 state 0x0 ref 2 00000100:00100000:2.0:1782487586.060372:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.060378:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+673:294505:x1869066294336384:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.060389:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.060402:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd06 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e32 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.060445:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+675:294503:x1869066294336128:12345-192.168.202.21@tcp:36:touch.500 Request processed in 394us (507us total) trans 8589956870 rc 0/0 00000100:00100000:2.0:1782487586.060453:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27000 00010000:00010000:3.0:1782487586.060506:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.060518:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.060527:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.060541:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.060549:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.060557:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.061054:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184d:0x0], index 1: 0 00010000:00010000:3.0:1782487586.061195:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061217:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061226:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061254:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061261:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061268:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061275:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.061279:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061286:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061297:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.061300:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.061304:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061310:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cd0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.061326:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad004009 reply state 00000000eca3b442 transno 8589956871 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.061333:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.061356:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd06 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e32 expref: 676 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061371:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e32 expref: 675 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.061379:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb55a37ba00) 00010000:00010000:3.0:1782487586.061382:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.061385:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578dea800, rc 0) 00010000:00010000:1.0:1782487586.061536:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061545:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061552:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061559:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.061564:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061576:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061587:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487586.061590:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.061593:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.061600:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85ccff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.061828:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+675:294505:x1869066294336384:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1451us (1635us total) trans 8589956871 rc 0/0 00000100:00100000:3.0:1782487586.061836:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27001 00000100:00100000:3.0:1782487586.061842:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481532640 time 7213481747167 state 0x2 ref 0 00000100:00100000:2.0:1782487586.061870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.061896:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294336512 00000100:00100000:3.0:1782487586.061902:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294336512 00000100:00100000:3.0:1782487586.061919:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481532640 time 7213481747167 state 0x0 ref 1 00000100:00100000:3.0:1782487586.061927:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481847167 time 7213481747167 state 0x1 ref 1 00000100:00100000:3.0:1782487586.061954:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481847167 time 7213483344730 state 0x0 ref 1 00000100:00100000:3.0:1782487586.062020:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+675:294503:x1869066294336512:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.062036:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.062049:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cd29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e39 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.062078:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cd29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e39 expref: 676 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.062090:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cd29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e39 expref: 676 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.062105:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487586.062108:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.062111:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb400, rc 0) 00010000:00010000:1.0:1782487586.062152:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.062162:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.062168:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.062183:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.062186:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.062193:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.062211:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb55a37b800) 00010000:00010000:1.0:1782487586.062214:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.062217:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.062273:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+676:294503:x1869066294336512:12345-192.168.202.21@tcp:101:touch.500 Request processed in 307us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.062282:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27002 00000100:00100000:3.0:1782487586.062287:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481847167 time 7213483344730 state 0x2 ref 0 00010000:00010000:1.0:1782487586.062319:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cd14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.063297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.063806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.063905:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294336896 00000100:00100000:3.0:1782487586.063912:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294336896 00000100:00100000:2.0:1782487586.063917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.063962:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16196 00000100:00100000:3.0:1782487586.063973:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2363:x1869066294336896:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.064023:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294336768 00000100:00100000:1.0:1782487586.064029:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294336768 00000100:00100000:1.0:1782487586.064049:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213481847167 time 7213483344730 state 0x0 ref 1 00000100:00100000:1.0:1782487586.064058:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213483444730 time 7213483344730 state 0x1 ref 1 00000100:00100000:1.0:1782487586.064074:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294337152 00000100:00100000:1.0:1782487586.064077:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294337152 00000100:00100000:1.0:1782487586.064088:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213483444730 time 7213483344730 state 0x1 ref 2 00000100:00100000:1.0:1782487586.064107:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213485598512 time 7213485498512 state 0x1 ref 2 00000100:00100000:1.0:1782487586.064119:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+676:294504:x1869066294336768:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487586.064120:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213485598512 time 7213485507053 state 0x0 ref 2 00010000:00010000:1.0:1782487586.064136:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.064142:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+676:294505:x1869066294337152:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.064151:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e40 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.064182:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.064215:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e32 expref: 677 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.064244:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb55a37ba00) 00010000:00010000:2.0:1782487586.064256:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.064259:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2363:x1869066294336896:12345-192.168.202.21@tcp:2:touch.500 Request processed in 286us (451us total) trans 8589940667 rc 0/0 00010000:00010000:1.0:1782487586.064263:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.064273:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16196 00010000:00010000:1.0:1782487586.064278:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064289:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.064306:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064307:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.064328:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064328:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064350:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.064360:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.064472:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fd6d236 reply state 000000004a28c4ff transno 8589956872 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.064481:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.064532:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+678:294505:x1869066294337152:12345-192.168.202.21@tcp:36:touch.500 Request processed in 396us (615us total) trans 8589956872 rc 0/0 00000100:00100000:2.0:1782487586.064540:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27004 00000004:00080000:1.0:1782487586.064739:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1874:0x0], index 0: 0 00010000:00010000:1.0:1782487586.064841:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cd4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064850:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cd4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064858:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cd4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064881:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064887:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064893:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064899:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.064903:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064911:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064923:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.064926:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.064930:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064936:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd37 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.064946:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c7570ae reply state 0000000049138592 transno 8589956873 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.064952:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.064970:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e40 expref: 679 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064981:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cd4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e40 expref: 678 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.064989:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:1.0:1782487586.064991:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.064993:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7c00, rc 0) 00000100:00100000:1.0:1782487586.065022:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294504:x1869066294336768:12345-192.168.202.21@tcp:101:touch.500 Request processed in 906us (1727us total) trans 8589956873 rc 0/0 00000100:00100000:1.0:1782487586.065028:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27003 00000100:00100000:1.0:1782487586.065032:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213485598512 time 7213485507053 state 0x2 ref 0 00010000:00010000:1.0:1782487586.066037:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066051:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066057:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066062:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.066065:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066079:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066090:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487586.066092:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.066095:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.066101:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cd3e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070464:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.070480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.070483:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070491:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070497:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.070502:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070510:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070524:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.070530:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782487586.070531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.070535:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070542:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cd45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.070576:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.070581:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294337280 00000100:00100000:1.0:1782487586.070590:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294337280 00000100:00100000:1.0:1782487586.070647:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213485598512 time 7213485507053 state 0x0 ref 1 00000100:00100000:1.0:1782487586.070659:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213485607053 time 7213485507053 state 0x1 ref 1 00000100:00100000:1.0:1782487586.070677:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294337536 00000100:00100000:3.0:1782487586.070680:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294337792 00000100:00100000:1.0:1782487586.070680:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294337536 00000100:00100000:3.0:1782487586.070684:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294337792 00000100:00100000:2.0:1782487586.070707:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213485607053 time 7213492084339 state 0x0 ref 1 00000100:00100000:3.0:1782487586.070718:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5765 00000100:00100000:3.0:1782487586.070728:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294503:x1869066294337792:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.070764:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213492184339 time 7213492084339 state 0x1 ref 2 00000100:00100000:1.0:1782487586.070784:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213492184339 time 7213492174544 state 0x0 ref 2 00000100:00100000:1.0:1782487586.070792:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294504:x1869066294337536:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.070817:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.070831:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cd4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e40 expref: 679 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070847:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:1.0:1782487586.070853:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.070906:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070917:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.070926:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.070935:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+679:294505:x1869066294337280:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.070947:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.070960:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cd61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e47 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.070989:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cd61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e47 expref: 681 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.070998:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc22df7c reply state 00000000590b76f6 transno 8589956875 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.070999:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cd61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e47 expref: 681 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.071018:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.071021:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.071023:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0ce00, rc 0) 00000100:00100000:1.0:1782487586.071027:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.071079:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294505:x1869066294337280:12345-192.168.202.21@tcp:101:touch.500 Request processed in 348us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.071088:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27005 00000100:00100000:3.0:1782487586.072685:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294503:x1869066294337792:12345-192.168.202.21@tcp:35:touch.500 Request processed in 1954us (2106us total) trans 8589956874 rc 0/0 00000100:00100000:1.0:1782487586.072694:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294504:x1869066294337536:12345-192.168.202.21@tcp:36:touch.500 Request processed in 1891us (2156us total) trans 8589956875 rc 0/0 00000100:00100000:2.0:1782487586.072695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.072701:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5765 00000100:00100000:1.0:1782487586.072705:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27006 00000100:00100000:1.0:1782487586.072710:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213492184339 time 7213492174544 state 0x2 ref 0 00000100:00100000:1.0:1782487586.072787:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294338048 00000100:00100000:1.0:1782487586.072793:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294338048 00000100:00100000:1.0:1782487586.072811:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213492184339 time 7213492174544 state 0x0 ref 1 00000100:00100000:1.0:1782487586.072819:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213492274544 time 7213492174544 state 0x1 ref 1 00000100:00100000:1.0:1782487586.072860:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213492274544 time 7213494250509 state 0x0 ref 1 00000100:00100000:1.0:1782487586.072871:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+680:294508:x1869066294338048:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.072883:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.072894:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e4e expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.072989:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073001:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073010:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073022:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073029:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073035:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.073439:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184e:0x0], index 1: 0 00010000:00010000:1.0:1782487586.073558:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073568:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073576:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073626:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073634:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073641:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073647:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.073651:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073658:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073668:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.073671:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.073675:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073681:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cd6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.073705:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000472b70ad reply state 00000000d23733e7 transno 8589956876 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.073713:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.073734:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85cd68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e4e expref: 683 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073751:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e4e expref: 682 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.073758:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb549170d00) 00010000:00010000:1.0:1782487586.073761:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.073763:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30600, rc 0) 00000100:00100000:1.0:1782487586.073799:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294508:x1869066294338048:12345-192.168.202.21@tcp:101:touch.500 Request processed in 930us (1107us total) trans 8589956876 rc 0/0 00000100:00100000:1.0:1782487586.073805:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27007 00000100:00100000:1.0:1782487586.073809:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213492274544 time 7213494250509 state 0x2 ref 0 00000100:00100000:1.0:1782487586.074569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.074667:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294338176 00000100:00100000:3.0:1782487586.074673:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294338176 00000100:00100000:3.0:1782487586.074785:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16197 00000100:00100000:3.0:1782487586.074794:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2362:x1869066294338176:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:2.0:1782487586.075317:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075328:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075401:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075409:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.075413:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.075421:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2362:x1869066294338176:12345-192.168.202.21@tcp:2:touch.500 Request processed in 625us (849us total) trans 8589940005 rc 0/0 00010000:00010000:2.0:1782487586.075425:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.075431:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16197 00010000:00010000:2.0:1782487586.075443:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:2.0:1782487586.075446:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.075451:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075457:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85cd5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.075600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.075686:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294338304 00000100:00100000:2.0:1782487586.075691:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294338304 00010000:00010000:3.0:1782487586.075717:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075726:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075733:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075739:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.075742:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075747:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075757:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb549170400) 00010000:00010000:3.0:1782487586.075759:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.075761:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.075765:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85cd76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.075845:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213492274544 time 7213494250509 state 0x0 ref 1 00000100:00100000:2.0:1782487586.075857:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213494350509 time 7213494250509 state 0x1 ref 1 00000100:00100000:2.0:1782487586.075885:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213494350509 time 7213497275105 state 0x0 ref 1 00000100:00100000:2.0:1782487586.075897:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+681:294504:x1869066294338304:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.075911:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.075927:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85cd8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e55 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075961:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85cd8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e55 expref: 682 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075974:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85cd8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e55 expref: 682 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.075996:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487586.075999:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.076003:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00000100:00100000:2.0:1782487586.076035:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294504:x1869066294338304:12345-192.168.202.21@tcp:101:touch.500 Request processed in 140us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.076042:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27008 00000100:00100000:2.0:1782487586.076047:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213494350509 time 7213497275105 state 0x2 ref 0 00000100:00100000:2.0:1782487586.076430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.076469:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294338560 00000100:00100000:3.0:1782487586.076474:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294338560 00000100:00100000:3.0:1782487586.076505:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5766 00000100:00100000:3.0:1782487586.076512:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+682:294505:x1869066294338560:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.076723:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294505:x1869066294338560:12345-192.168.202.21@tcp:35:touch.500 Request processed in 210us (294us total) trans 8589956877 rc 0/0 00000100:00100000:3.0:1782487586.076731:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5766 00000100:00100000:1.0:1782487586.077260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.077312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.077406:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294338688 00000100:00100000:2.0:1782487586.077411:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294338688 00000100:00100000:2.0:1782487586.077453:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16198 00000100:00100000:2.0:1782487586.077463:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2363:x1869066294338688:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.077491:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294339200 00000100:00100000:3.0:1782487586.077498:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294339200 00000100:00100000:3.0:1782487586.077529:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213494350509 time 7213497275105 state 0x0 ref 1 00000100:00100000:3.0:1782487586.077540:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213497375105 time 7213497275105 state 0x1 ref 1 00000100:00100000:3.0:1782487586.077567:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213497375105 time 7213498957315 state 0x0 ref 1 00000100:00100000:3.0:1782487586.077593:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+683:294508:x1869066294339200:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487586.077651:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.077680:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cd7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e4e expref: 683 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.077701:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb549170d00) 00010000:00010000:3.0:1782487586.077712:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.077757:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.077770:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.077780:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.077870:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1bb0b55 reply state 00000000fc33976e transno 8589956878 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.077880:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.077944:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+684:294508:x1869066294339200:12345-192.168.202.21@tcp:36:touch.500 Request processed in 355us (641us total) trans 8589956878 rc 0/0 00000100:00100000:3.0:1782487586.077952:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27009 00000100:00100000:3.0:1782487586.077957:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213497375105 time 7213498957315 state 0x2 ref 0 00000100:00100000:1.0:1782487586.078108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.078150:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294339072 00000100:00100000:3.0:1782487586.078155:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294339072 00000100:00100000:3.0:1782487586.078175:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213497375105 time 7213498957315 state 0x0 ref 1 00000100:00100000:3.0:1782487586.078185:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213499057315 time 7213498957315 state 0x1 ref 1 00000100:00100000:2.0:1782487586.078243:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+139:2363:x1869066294338688:12345-192.168.202.21@tcp:2:touch.500 Request processed in 781us (982us total) trans 8589940668 rc 0/0 00000100:00100000:2.0:1782487586.078252:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16198 00000100:00100000:3.0:1782487586.078740:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213499057315 time 7213500129569 state 0x0 ref 1 00000100:00100000:3.0:1782487586.078754:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+684:294509:x1869066294339072:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.078764:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.078776:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd99 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e5c expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078872:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078884:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078894:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078909:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078917:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.078925:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.079512:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1875:0x0], index 0: 0 00010000:00010000:3.0:1782487586.079816:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cdae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079827:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cdae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079837:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cdae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079872:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079879:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079886:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079893:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.079898:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079906:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079917:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.079920:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.079925:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.079931:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cda0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.079944:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4ee9004 reply state 000000009d489c48 transno 8589956879 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.079952:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.079978:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578dea800/0x66475b4e8b85cd99 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e5c expref: 687 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080000:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cdae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e5c expref: 686 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080009:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb55a37b800) 00010000:00010000:3.0:1782487586.080012:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.080015:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1400, rc 0) 00000100:00100000:3.0:1782487586.080070:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294509:x1869066294339072:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1318us (1961us total) trans 8589956879 rc 0/0 00000100:00100000:3.0:1782487586.080079:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27010 00000100:00100000:3.0:1782487586.080085:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213499057315 time 7213500129569 state 0x2 ref 0 00000100:00100000:1.0:1782487586.080373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.080415:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294339328 00000100:00100000:2.0:1782487586.080421:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294339328 00000100:00100000:2.0:1782487586.080445:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213499057315 time 7213500129569 state 0x0 ref 1 00000100:00100000:2.0:1782487586.080455:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213500229569 time 7213500129569 state 0x1 ref 1 00000100:00100000:2.0:1782487586.080483:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213500229569 time 7213501873253 state 0x0 ref 1 00000100:00100000:2.0:1782487586.080492:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294508:x1869066294339328:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.080506:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.080515:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85cdbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e63 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.080542:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85cdbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e63 expref: 688 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.080550:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85cdbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e63 expref: 688 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.080562:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.080564:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.080567:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb541391600, rc 0) 00000100:00100000:2.0:1782487586.080588:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294508:x1869066294339328:12345-192.168.202.21@tcp:101:touch.500 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.080594:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27011 00000100:00100000:2.0:1782487586.080597:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213500229569 time 7213501873253 state 0x2 ref 0 00010000:00010000:3.0:1782487586.080889:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080898:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.080906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.080913:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080920:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.080924:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080931:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080943:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:3.0:1782487586.080947:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.080950:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.080956:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cd92 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.081239:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294339584 00000100:00100000:1.0:1782487586.081244:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294339584 00000100:00100000:1.0:1782487586.081271:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5767 00000100:00100000:1.0:1782487586.081277:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294504:x1869066294339584:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.081451:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294504:x1869066294339584:12345-192.168.202.21@tcp:35:touch.500 Request processed in 174us (549us total) trans 8589956880 rc 0/0 00000100:00100000:1.0:1782487586.081457:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5767 00010000:00010000:3.0:1782487586.081772:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081781:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081787:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081794:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.081798:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081806:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081818:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb55a37ba00) 00010000:00010000:3.0:1782487586.081821:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.081824:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.081831:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cda7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.081905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.082232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.082249:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294339840 00000100:00100000:3.0:1782487586.082256:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294339840 00000100:00100000:2.0:1782487586.082260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.082278:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213500229569 time 7213501873253 state 0x0 ref 1 00000100:00100000:1.0:1782487586.082280:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340096 00000100:00100000:1.0:1782487586.082287:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340096 00000100:00100000:3.0:1782487586.082301:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213501973253 time 7213501873253 state 0x1 ref 1 00000100:00100000:1.0:1782487586.082311:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213501973253 time 7213501873253 state 0x1 ref 2 00000100:00100000:3.0:1782487586.082328:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340224 00000100:00100000:3.0:1782487586.082333:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340224 00000100:00100000:1.0:1782487586.082346:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213503835315 time 7213503735315 state 0x1 ref 2 00000100:00100000:1.0:1782487586.082360:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+688:294509:x1869066294339840:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.082385:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.082395:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cdae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e5c expref: 688 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.082404:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb55a37b800) 00010000:00010000:1.0:1782487586.082409:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487586.082423:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213503835315 time 7213503812541 state 0x0 ref 2 00000100:00100000:2.0:1782487586.082435:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+687:294512:x1869066294340096:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.082443:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.082451:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.082454:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cdca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e6a expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.082461:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.082469:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.082480:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16199 00000100:00100000:3.0:1782487586.082489:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2362:x1869066294340224:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:2.0:1782487586.082541:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.082545:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a53a4030 reply state 00000000c51c4aa4 transno 8589956881 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.082550:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.082566:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.082567:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.082578:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.082583:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.082588:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.082634:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294509:x1869066294339840:12345-192.168.202.21@tcp:36:touch.500 Request processed in 275us (730us total) trans 8589956881 rc 0/0 00000100:00100000:1.0:1782487586.082640:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27012 00000100:00100000:3.0:1782487586.082855:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2362:x1869066294340224:12345-192.168.202.21@tcp:2:touch.500 Request processed in 365us (592us total) trans 8589940006 rc 0/0 00000100:00100000:3.0:1782487586.082864:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16199 00000004:00080000:2.0:1782487586.083072:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184f:0x0], index 1: 0 00010000:00010000:2.0:1782487586.083214:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cddf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083224:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083233:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083257:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083265:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083270:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083274:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.083277:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083281:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083289:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.083291:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.083293:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083297:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cdd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.083307:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eda2bd5 reply state 00000000d855480e transno 8589956882 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.083311:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.083338:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cdca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e6a expref: 691 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083355:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e6a expref: 690 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.083364:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.083366:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.083369:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45653dc00, rc 0) 00000100:00100000:2.0:1782487586.083403:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:294512:x1869066294340096:12345-192.168.202.21@tcp:101:touch.500 Request processed in 971us (1172us total) trans 8589956882 rc 0/0 00000100:00100000:2.0:1782487586.083409:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27013 00000100:00100000:2.0:1782487586.083413:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213503835315 time 7213503812541 state 0x2 ref 0 00010000:00010000:3.0:1782487586.083822:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083831:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083837:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083842:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.083845:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083852:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083861:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:3.0:1782487586.083864:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.083867:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.083874:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cdc3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.085005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.085101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.085140:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340608 00000100:00100000:2.0:1782487586.085147:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340608 00010000:00010000:3.0:1782487586.085160:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.085169:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.085175:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.085181:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579c7ac00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.085185:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.085188:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5768 00010000:00010000:3.0:1782487586.085197:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.085213:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294508:x1869066294340608:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487586.085226:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2f900) 00010000:00010000:3.0:1782487586.085230:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.085234:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.085235:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340352 00000100:00100000:1.0:1782487586.085241:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340352 00010000:00010000:3.0:1782487586.085243:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579c7ac00/0x66475b4e8b85cdd8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.085265:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213503835315 time 7213503812541 state 0x0 ref 1 00000100:00100000:1.0:1782487586.085276:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213503912541 time 7213503812541 state 0x1 ref 1 00000100:00100000:1.0:1782487586.085296:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213503912541 time 7213506686396 state 0x0 ref 1 00000100:00100000:3.0:1782487586.085308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.085312:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+690:294509:x1869066294340352:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.085324:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.085338:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cded lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e71 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085373:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cded lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e71 expref: 692 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085380:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cded lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e71 expref: 692 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085391:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.085394:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.085395:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30c00, rc 0) 00000100:00100000:1.0:1782487586.085428:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294509:x1869066294340352:12345-192.168.202.21@tcp:101:touch.500 Request processed in 122us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.085434:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27014 00000100:00100000:1.0:1782487586.085437:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213503912541 time 7213506686396 state 0x2 ref 0 00000100:00100000:1.0:1782487586.085450:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340864 00000100:00100000:1.0:1782487586.085452:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340864 00000100:00100000:1.0:1782487586.085460:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213503912541 time 7213506686396 state 0x0 ref 1 00000100:00100000:1.0:1782487586.085467:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506786396 time 7213506686396 state 0x1 ref 1 00000100:00100000:2.0:1782487586.085486:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294508:x1869066294340608:12345-192.168.202.21@tcp:35:touch.500 Request processed in 285us (447us total) trans 8589956883 rc 0/0 00000100:00100000:1.0:1782487586.085486:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506786396 time 7213506875589 state 0x0 ref 1 00000100:00100000:2.0:1782487586.085498:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5768 00000100:00100000:1.0:1782487586.085502:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294512:x1869066294340864:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.085528:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.085541:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cddf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e6a expref: 691 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085552:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487586.085558:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.085597:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085625:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.085634:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.085682:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa8137e8 reply state 000000008abe275b transno 8589956884 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.085690:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.085739:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+692:294512:x1869066294340864:12345-192.168.202.21@tcp:36:touch.500 Request processed in 241us (437us total) trans 8589956884 rc 0/0 00000100:00100000:1.0:1782487586.085745:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27015 00000100:00100000:1.0:1782487586.085749:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506786396 time 7213506875589 state 0x2 ref 0 00000100:00100000:3.0:1782487586.086726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.087028:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087035:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087040:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087044:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.087047:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087053:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087063:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.087067:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.087071:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087076:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cdf4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.087230:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294340992 00000100:00100000:2.0:1782487586.087231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.087236:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294340992 00000100:00100000:1.0:1782487586.087254:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506786396 time 7213506875589 state 0x0 ref 1 00000100:00100000:1.0:1782487586.087260:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506975589 time 7213506875589 state 0x1 ref 1 00000100:00100000:3.0:1782487586.087280:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341248 00000100:00100000:1.0:1782487586.087280:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506975589 time 7213508671404 state 0x0 ref 1 00000100:00100000:3.0:1782487586.087287:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341248 00000100:00100000:1.0:1782487586.087295:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+691:294516:x1869066294340992:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.087306:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.087319:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cdfb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e78 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.087336:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16200 00000100:00100000:3.0:1782487586.087356:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+139:2361:x1869066294341248:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:1.0:1782487586.087364:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087373:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087379:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087388:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087392:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087397:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087471:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087477:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.087484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.087485:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.087501:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341120 00000004:00200000:1.0:1782487586.087504:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3b:0x0]: returning size 0 00000100:00100000:2.0:1782487586.087505:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341120 00000004:00200000:1.0:1782487586.087511:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.087526:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.087536:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1147 00010000:00010000:1.0:1782487586.087538:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.087544:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+693:2363:x1869066294341120:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487586.087555:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087563:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087567:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087570:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.087572:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087575:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.087578:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.087586:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.087587:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ce17 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e7f expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087592:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.087598:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087626:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85ce02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087634:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087638:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087642:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087645:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.087646:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087650:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087655:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb549170d00) 00010000:00010000:1.0:1782487586.087656:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.087658:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087661:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6200/0x66475b4e8b85ce09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087683:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85cdfb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e78 expref: 695 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087695:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e78 expref: 694 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.087702:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:1.0:1782487586.087704:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.087707:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7600, rc 0) 00000100:00100000:1.0:1782487586.087748:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+694:294516:x1869066294340992:12345-192.168.202.21@tcp:101:rm.500 Request processed in 457us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.087757:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27016 00000100:00100000:3.0:1782487586.087758:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2361:x1869066294341248:12345-192.168.202.21@tcp:2:touch.500 Request processed in 401us (525us total) trans 8589940669 rc 0/0 00000100:00100000:1.0:1782487586.087761:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506975589 time 7213508671404 state 0x2 ref 0 00000100:00100000:3.0:1782487586.087773:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16200 00000100:00100000:3.0:1782487586.087864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.088060:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088071:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088081:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088100:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088108:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088116:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088191:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088200:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088219:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088229:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341376 00000100:00100000:1.0:1782487586.088233:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341376 00000004:00200000:2.0:1782487586.088234:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3d:0x0]: returning size 0 00000004:00200000:2.0:1782487586.088238:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1782487586.088245:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213506975589 time 7213508671404 state 0x0 ref 1 00000004:00010000:2.0:1782487586.088251:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088251:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213508771404 time 7213508671404 state 0x1 ref 1 00010000:00010000:2.0:1782487586.088267:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088275:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088280:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213508771404 time 7213509670810 state 0x0 ref 1 00010000:00010000:2.0:1782487586.088283:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088291:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+694:294512:x1869066294341376:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.088303:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088307:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.088310:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088315:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088319:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85ce33 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477eb7 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088322:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088348:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.088352:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088355:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088356:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85ce33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eb7 expref: 695 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088365:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85ce1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088371:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85ce33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eb7 expref: 695 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088375:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088381:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088382:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:2.0:1782487586.088389:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.088389:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.088391:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7a00, rc 0) 00010000:00010000:2.0:1782487586.088396:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088399:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088405:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088411:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4c9e2fd00) 00010000:00010000:2.0:1782487586.088412:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088414:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088417:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85ce25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088425:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+695:294512:x1869066294341376:12345-192.168.202.21@tcp:101:touch.500 Request processed in 135us (561us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.088435:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ce17 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e7f expref: 696 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.088436:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27017 00000100:00100000:1.0:1782487586.088445:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213508771404 time 7213509670810 state 0x2 ref 0 00010000:00010000:2.0:1782487586.088448:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e7f expref: 695 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088457:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.088458:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.088460:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7600, rc 0) 00010000:00010000:2.0:1782487586.088464:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.088470:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ce3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e86 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088487:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088492:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088498:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088508:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088513:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088518:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088563:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088568:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088573:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.088582:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.088588:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088594:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088599:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088603:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088632:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088636:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54151a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088637:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088641:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088647:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.088649:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088651:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088655:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ce41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088664:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088668:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088672:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088676:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088679:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088685:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088691:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb451f41600) 00010000:00010000:2.0:1782487586.088693:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088695:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088704:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85ce48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088722:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ce3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e86 expref: 696 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088731:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e86 expref: 695 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088736:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:2.0:1782487586.088738:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.088740:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00010000:00010000:2.0:1782487586.088743:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.088749:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85ce56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477e8d expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088773:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088779:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088785:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088794:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088799:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088804:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088830:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088834:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088838:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088844:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088848:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088855:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088864:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.088868:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088871:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088878:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ce5d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088890:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088894:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088899:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088903:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.088905:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088910:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088917:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb451f41500) 00010000:00010000:2.0:1782487586.088918:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.088921:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088924:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088944:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85ce56 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e8d expref: 696 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088956:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.088957:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.088960:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85ce56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e8d expref: 696 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.088968:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4800, rc -2) 00000100:00100000:2.0:1782487586.089005:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+695:2363:x1869066294341120:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1462us (1522us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.089014:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1147 00000100:00100000:2.0:1782487586.089876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.089971:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341504 00000100:00100000:3.0:1782487586.089977:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341504 00000100:00100000:2.0:1782487586.089998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.090023:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341632 00000100:00100000:3.0:1782487586.090028:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341632 00000100:00100000:3.0:1782487586.090059:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16201 00000100:00100000:2.0:1782487586.090070:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16202 00000100:00100000:3.0:1782487586.090071:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2362:x1869066294341504:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.090085:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.090086:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2360:x1869066294341632:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487586.090101:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ebe expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487586.090123:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184d:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.090136:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.090141:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.090149:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 119 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.090164:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 119 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.090180:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578dea800, rc 0) 00000100:00100000:3.0:1782487586.090225:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2362:x1869066294341504:12345-192.168.202.21@tcp:101:rm.500 Request processed in 158us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.090233:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16201 00000100:00100000:2.0:1782487586.090299:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2360:x1869066294341632:12345-192.168.202.21@tcp:2:touch.500 Request processed in 218us (302us total) trans 8589940007 rc 0/0 00000100:00100000:2.0:1782487586.090308:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16202 00000100:00100000:2.0:1782487586.090814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.092250:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294341888 00000100:00100000:1.0:1782487586.092258:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294341888 00000100:00100000:1.0:1782487586.092420:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5769 00000100:00100000:1.0:1782487586.092429:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57ed90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+695:294509:x1869066294341888:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.092701:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57ed90050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+696:294509:x1869066294341888:12345-192.168.202.21@tcp:35:touch.500 Request processed in 272us (1886us total) trans 8589956885 rc 0/0 00000100:00100000:1.0:1782487586.092708:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5769 00000100:00100000:3.0:1782487586.096600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.096649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.096677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.096695:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342400 00000100:00100000:2.0:1782487586.096703:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342400 00000100:00100000:2.0:1782487586.096751:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5770 00000100:00100000:2.0:1782487586.096762:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+696:294512:x1869066294342400:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.097036:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+697:294512:x1869066294342400:12345-192.168.202.21@tcp:35:touch.500 Request processed in 275us (386us total) trans 8589956886 rc 0/0 00000100:00100000:2.0:1782487586.097045:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5770 00000100:00100000:1.0:1782487586.097543:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342016 00000100:00100000:1.0:1782487586.097547:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342016 00000100:00100000:1.0:1782487586.097577:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342144 00000100:00100000:1.0:1782487586.097580:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342144 00000100:00100000:1.0:1782487586.097625:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16203 00000100:00100000:1.0:1782487586.097634:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2363:x1869066294342016:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487586.097645:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.097652:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16204 00010000:00010000:1.0:1782487586.097663:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ec5 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.097664:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2363:x1869066294342144:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487586.097675:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1782487586.097690:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184e:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.097691:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ecc expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.097707:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.097713:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.097722:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 120 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.097737:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 120 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.097750:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6200, rc 0) 00000100:00100000:1.0:1782487586.097777:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2363:x1869066294342016:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 145us (1185us total) trans 0 rc 0/0 00002000:00010000:3.0:1782487586.097830:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1875:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.097843:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.097848:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.097856:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 141 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.097871:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 141 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.097881:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579c7ac00, rc 0) 00000100:00100000:3.0:1782487586.097905:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2363:x1869066294342144:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 245us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.100277:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16203 00000100:00100000:3.0:1782487586.100304:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16204 00000100:00100000:3.0:1782487586.100509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.100585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.100649:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342656 00000100:00100000:2.0:1782487586.100655:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342656 00000100:00100000:2.0:1782487586.100749:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1148 00000100:00100000:2.0:1782487586.100762:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+697:2363:x1869066294342656:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:1.0:1782487586.100791:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342528 00010000:00010000:2.0:1782487586.100793:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.100799:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342528 00010000:00010000:2.0:1782487586.100811:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477eda expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.100824:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213508771404 time 7213509670810 state 0x0 ref 1 00000100:00100000:1.0:1782487586.100837:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213509770810 time 7213509670810 state 0x1 ref 1 00010000:00010000:2.0:1782487586.100858:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.100860:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213509770810 time 7213522250423 state 0x0 ref 1 00010000:00010000:2.0:1782487586.100880:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.100880:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+699:294514:x1869066294342528:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.100895:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.100897:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100909:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85ce8e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ed3 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.100913:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.100927:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.100933:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100949:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100961:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100970:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100985:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.100993:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101002:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101055:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101065:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101077:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101084:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.101095:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3c:0x0]: returning size 0 00010000:00010000:1.0:1782487586.101095:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.101102:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.101107:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.101118:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.101128:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3a:0x0]: returning size 0 00010000:00010000:2.0:1782487586.101131:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.101132:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.101147:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101154:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101158:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101168:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101177:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101414:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101423:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101430:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101431:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.101439:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101440:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.101446:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101450:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101463:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.101466:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.101470:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101480:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8c000/0x66475b4e8b85ce87 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101493:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101499:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101505:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101508:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101520:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.101526:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.101528:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.101531:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101533:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101548:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85ce9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101550:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101568:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb451f41500) 00010000:00010000:2.0:1782487586.101571:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.101572:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101574:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101590:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101597:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85ce95 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101600:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101654:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85ce80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 701 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101672:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 700 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101679:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487586.101682:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.101684:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d600, rc 0) 00010000:00010000:1.0:1782487586.101868:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.101872:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101880:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101884:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.101893:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.101896:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ceb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ee1 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101897:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.101903:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.101913:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cea3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.101926:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102017:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102028:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.102033:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85ce8e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 702 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102044:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.102051:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 701 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102054:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.102065:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:2.0:1782487586.102068:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.102069:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.102074:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1a00, rc 0) 00010000:00010000:2.0:1782487586.102125:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102135:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.102161:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+701:294514:x1869066294342528:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1283us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.102170:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27018 00000100:00100000:1.0:1782487586.102176:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213509770810 time 7213522250423 state 0x2 ref 0 00010000:00010000:2.0:1782487586.102198:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.102226:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3d:0x0]: returning size 0 00000004:00200000:2.0:1782487586.102229:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.102239:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102247:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102254:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102260:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102266:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102271:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.102274:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102280:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102341:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.102345:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.102348:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102354:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85cebf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102366:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102372:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102378:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102383:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.102386:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102392:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102398:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb451f41600) 00010000:00010000:2.0:1782487586.102400:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.102403:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102409:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85cec6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102427:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85ceb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee1 expref: 701 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102438:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee1 expref: 700 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102446:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.102448:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.102450:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4000, rc 0) 00010000:00010000:2.0:1782487586.102454:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.102461:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ced4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477ee8 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102480:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102488:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102495:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102506:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102568:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102576:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102749:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102759:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102766:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.102779:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3e:0x0]: returning size 0 00000004:00200000:2.0:1782487586.102781:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.102790:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102798:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102804:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102810:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102817:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102822:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.102825:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102831:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102838:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.102840:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.102844:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102850:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85cedb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102860:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102866:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102871:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102876:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.102879:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102885:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102891:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4b6109000) 00010000:00010000:2.0:1782487586.102893:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.102896:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102901:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85cee2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102920:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85ced4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee8 expref: 702 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102931:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee8 expref: 701 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.102991:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:2.0:1782487586.102993:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.102996:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30400, rc 0) 00010000:00010000:2.0:1782487586.103000:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.103008:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477eef expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103028:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103036:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103043:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103055:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103062:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103068:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103091:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103098:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103104:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103110:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.103113:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103119:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103126:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.103128:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.103131:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103137:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85cef7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103212:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103218:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103224:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103229:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.103232:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103239:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103246:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c5d1a800) 00010000:00010000:2.0:1782487586.103249:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.103251:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103257:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85cefe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103275:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cef0 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eef expref: 702 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103284:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.103342:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.103347:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cef0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eef expref: 702 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.103356:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30600, rc -2) 00000100:00100000:2.0:1782487586.103396:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+701:2363:x1869066294342656:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2640us (2812us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.103403:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1148 00000100:00100000:3.0:1782487586.103811:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.103848:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294342784 00000100:00100000:2.0:1782487586.103854:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294342784 00000100:00100000:2.0:1782487586.103892:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16205 00000100:00100000:2.0:1782487586.103900:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2361:x1869066294342784:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.103910:0:213226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.103925:0:213226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f0b expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.103995:0:213226:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1873:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.104008:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.104012:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.104020:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 142 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.104032:0:213226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 142 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.104043:0:213226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb456343400, rc 0) 00000100:00100000:2.0:1782487586.104069:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+142:2361:x1869066294342784:12345-192.168.202.21@tcp:101:rm.500 Request processed in 171us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.104076:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16205 00000100:00100000:3.0:1782487586.104473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.104655:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343040 00000100:00100000:1.0:1782487586.104660:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343040 00000100:00100000:1.0:1782487586.104681:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213509770810 time 7213522250423 state 0x0 ref 1 00000100:00100000:1.0:1782487586.104691:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213522350423 time 7213522250423 state 0x1 ref 1 00000100:00100000:1.0:1782487586.104721:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213522350423 time 7213526111320 state 0x0 ref 1 00000100:00100000:1.0:1782487586.104732:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+701:294518:x1869066294343040:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.104742:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.104752:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f12 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104840:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104852:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104862:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104876:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104889:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.104897:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.105508:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1876:0x0], index 0: 0 00010000:00010000:1.0:1782487586.105787:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cf21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105797:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cf21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105806:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cf21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105834:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105842:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105849:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105856:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.105860:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105868:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105885:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.105888:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.105893:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105900:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.105913:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6a9e224 reply state 00000000c2a135d1 transno 8589956887 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.105921:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.105944:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f12 expref: 704 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105958:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cf21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f12 expref: 703 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.105965:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487586.105968:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.105971:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498600, rc 0) 00000100:00100000:1.0:1782487586.106052:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+704:294518:x1869066294343040:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1321us (1580us total) trans 8589956887 rc 0/0 00000100:00100000:1.0:1782487586.106061:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27019 00000100:00100000:1.0:1782487586.106066:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213522350423 time 7213526111320 state 0x2 ref 0 00000100:00100000:3.0:1782487586.106544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.106580:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343168 00000100:00100000:2.0:1782487586.106594:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343168 00000100:00100000:2.0:1782487586.106644:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16206 00000100:00100000:2.0:1782487586.106652:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+142:2361:x1869066294343168:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:2.0:1782487586.106662:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.106675:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f19 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.106781:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1874:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.106794:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.106799:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.106806:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 143 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.106820:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 143 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.106830:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8c000, rc 0) 00000100:00100000:2.0:1782487586.106858:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+143:2361:x1869066294343168:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 207us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.106865:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16206 00010000:00010000:3.0:1782487586.106945:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.106955:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.106962:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.106969:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.106973:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.106981:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.106992:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb549170e00) 00010000:00010000:3.0:1782487586.106995:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.106999:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.107006:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf1a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.107723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.107757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.107758:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343680 00000100:00100000:2.0:1782487586.107763:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343680 00000100:00100000:2.0:1782487586.107782:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213522350423 time 7213526111320 state 0x0 ref 1 00000100:00100000:2.0:1782487586.107791:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213526211320 time 7213526111320 state 0x1 ref 1 00000100:00100000:3.0:1782487586.107799:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343552 00000100:00100000:3.0:1782487586.107811:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343552 00000100:00100000:2.0:1782487586.107813:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213526211320 time 7213529202520 state 0x0 ref 1 00000100:00100000:2.0:1782487586.107825:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+704:294518:x1869066294343680:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487586.107834:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213529302520 time 7213529202520 state 0x1 ref 2 00010000:00010000:2.0:1782487586.107858:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.107874:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85cf21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f12 expref: 704 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.107878:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213529302520 time 7213529266725 state 0x0 ref 2 00010000:00010000:2.0:1782487586.107897:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb4c9e2fd00) 00000100:00100000:3.0:1782487586.107903:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+703:294519:x1869066294343552:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.107906:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.107915:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.107927:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cf36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f20 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.107962:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.107974:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.107982:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.108043:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.108054:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.108068:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.108075:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9cf9eeb reply state 00000000ead7d955 transno 8589956888 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.108084:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.108084:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.108099:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.108107:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.108134:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+706:294518:x1869066294343680:12345-192.168.202.21@tcp:36:touch.500 Request processed in 311us (412us total) trans 8589956888 rc 0/0 00000100:00100000:2.0:1782487586.108153:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27020 00000004:00080000:3.0:1782487586.108825:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1850:0x0], index 1: 0 00010000:00010000:2.0:1782487586.108860:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108869:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108875:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108881:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.108884:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108892:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108900:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb56d889b00) 00010000:00010000:2.0:1782487586.108903:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.108907:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.108914:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85cf3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109081:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85cf52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.109125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.109150:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85cf52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109162:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85cf52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109198:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109216:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109224:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109230:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.109234:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109242:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109253:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.109256:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.109260:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109271:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85cf44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.109290:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f46f709c reply state 000000000a3359dc transno 8589956889 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.109298:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.109320:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85cf36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f20 expref: 706 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109334:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85cf52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f20 expref: 705 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109342:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:3.0:1782487586.109345:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.109348:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35eda00, rc 0) 00000100:00100000:3.0:1782487586.109387:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+706:294519:x1869066294343552:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1493us (1630us total) trans 8589956889 rc 0/0 00000100:00100000:3.0:1782487586.109395:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27021 00000100:00100000:3.0:1782487586.109401:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213529302520 time 7213529266725 state 0x2 ref 0 00000100:00100000:3.0:1782487586.109422:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343808 00000100:00100000:3.0:1782487586.109433:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343808 00000100:00100000:3.0:1782487586.109448:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213529302520 time 7213529266725 state 0x0 ref 1 00000100:00100000:3.0:1782487586.109462:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213529366725 time 7213529266725 state 0x1 ref 1 00000100:00100000:3.0:1782487586.109526:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213529366725 time 7213530873415 state 0x0 ref 1 00000100:00100000:3.0:1782487586.109540:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+706:294518:x1869066294343808:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.109551:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.109571:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85cf60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f27 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109626:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85cf60 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f27 expref: 707 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109639:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85cf60 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f27 expref: 707 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.109659:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487586.109662:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.109665:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54600, rc 0) 00000100:00100000:3.0:1782487586.109702:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+707:294518:x1869066294343808:12345-192.168.202.21@tcp:101:touch.500 Request processed in 164us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.109714:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27022 00000100:00100000:3.0:1782487586.109719:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213529366725 time 7213530873415 state 0x2 ref 0 00010000:00010000:3.0:1782487586.110235:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110244:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110252:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110269:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.110273:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110281:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110399:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4a4c88a00) 00010000:00010000:3.0:1782487586.110403:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.110407:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.110414:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cf4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.112751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.112776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.112804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.112827:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294343936 00000100:00100000:1.0:1782487586.112835:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294343936 00000100:00100000:1.0:1782487586.112868:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213529366725 time 7213530873415 state 0x0 ref 1 00000100:00100000:1.0:1782487586.112879:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213530973415 time 7213530873415 state 0x1 ref 1 00000100:00100000:1.0:1782487586.112900:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344192 00000100:00100000:1.0:1782487586.112903:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344192 00000100:00100000:1.0:1782487586.112916:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213530973415 time 7213530873415 state 0x1 ref 2 00000100:00100000:1.0:1782487586.112935:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213534426149 time 7213534326149 state 0x1 ref 2 00000100:00100000:1.0:1782487586.112947:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+707:294520:x1869066294343936:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.112968:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.112979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.112986:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85cf67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f2e expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.112999:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.113022:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.113039:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113054:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113066:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113081:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113089:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113097:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113212:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113222:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113232:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.113255:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3c:0x0]: returning size 0 00000004:00200000:1.0:1782487586.113260:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.113276:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113297:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113307:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113312:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113319:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113325:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.113329:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113336:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113357:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.113361:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.113365:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113370:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85cf6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113385:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113391:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113397:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113403:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.113406:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113413:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113423:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487586.113426:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.113429:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113435:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85cf75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113476:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85cf67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f2e expref: 709 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113493:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f2e expref: 708 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113501:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.113504:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.113507:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7e00, rc 0) 00000100:00100000:1.0:1782487586.113561:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+708:294520:x1869066294343936:12345-192.168.202.21@tcp:101:rm.500 Request processed in 615us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.113570:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27023 00000100:00100000:1.0:1782487586.113593:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344320 00000100:00100000:1.0:1782487586.113597:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344320 00000100:00100000:1.0:1782487586.113639:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213534426149 time 7213534326149 state 0x1 ref 2 00000100:00100000:1.0:1782487586.113700:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344448 00000100:00100000:0.0:1782487586.113700:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299219456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782487586.113705:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344448 00000100:00100000:1.0:1782487586.113720:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213534426149 time 7213534326149 state 0x1 ref 3 00000100:00100000:1.0:1782487586.113729:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344576 00000100:00100000:1.0:1782487586.113732:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344576 00000100:00100000:1.0:1782487586.113743:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213534426149 time 7213534326149 state 0x1 ref 4 00000100:00100000:0.0:1782487586.113752:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487586.113757:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213535247654 time 7213535147654 state 0x1 ref 4 00000100:00100000:1.0:1782487586.113767:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294519:x1869066294344192:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.113792:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487586.113810:0:198596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219456 00010000:00010000:1.0:1782487586.113810:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85cf52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f20 expref: 710 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.113816:0:198596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219456 00010000:00010000:1.0:1782487586.113828:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4a4c88600) 00010000:00010000:1.0:1782487586.113841:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487586.113849:0:198596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1782487586.113858:0:198596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066299219456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782487586.113872:0:198596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37289984 pending 0 free 3818913792 avail 3816816640 00010000:00010000:1.0:1782487586.113889:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.113899:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.113913:0:198596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066299219456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.113919:0:198596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1782487586.113938:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299219456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782487586.113984:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213535472692 time 7213535372692 state 0x1 ref 4 00000100:00100000:0.0:1782487586.113989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487586.113996:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44b4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299219968:0@lo:400:kworker.0 00000100:00100000:3.0:1782487586.114004:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344704 00000100:00100000:3.0:1782487586.114009:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344704 00000100:00100000:0.0:1782487586.114025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487586.114038:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066299219840:0@lo:400:kworker.0 00000100:00100000:0.0:1782487586.114061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487586.114078:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1149 00000100:00100000:3.0:1782487586.114088:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:2361:x1869066294344704:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:2.0:1782487586.114095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.114113:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344832 00010000:00010000:3.0:1782487586.114114:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.114117:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344832 00010000:00010000:3.0:1782487586.114126:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85cf8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f4a expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114154:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.114154:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1150 00000100:00100000:2.0:1782487586.114166:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+712:2362:x1869066294344832:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487586.114167:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114179:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114185:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.114192:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114199:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85cf9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f51 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114212:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114230:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114246:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114256:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114265:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114269:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114278:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114281:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114287:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114294:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.114300:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114304:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114310:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114316:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114323:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.114327:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.114331:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114338:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85cf91 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114349:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114351:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114359:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114364:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114370:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114374:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114379:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.114383:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.114385:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114388:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114399:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114416:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114419:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4a4c88d00) 00010000:00010000:3.0:1782487586.114425:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.114430:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114433:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.114439:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85cf98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114439:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.114443:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114452:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85cfa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114463:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114469:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85cf8a lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f4a expref: 713 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114472:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114489:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114501:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.114503:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.114505:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114508:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.114515:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85cf8a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f4a expref: 713 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114529:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.114532:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55800, rc -2) 00010000:00010000:2.0:1782487586.114542:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb56d889800) 00010000:00010000:2.0:1782487586.114544:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.114547:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114554:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85cfad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.114569:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+712:2361:x1869066294344704:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 482us (1544us total) trans 0 rc -2/-2 00010000:00010000:2.0:1782487586.114578:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85cf9f lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f51 expref: 712 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114588:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.114591:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1782487586.114596:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1149 00010000:00010000:2.0:1782487586.114596:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85cf9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f51 expref: 712 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.114628:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd7a000, rc -2) 00000100:00100000:2.0:1782487586.114654:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:2362:x1869066294344832:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 490us (565us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.114661:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1150 00000100:00100000:3.0:1782487586.114735:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219968 00000100:00100000:2.0:1782487586.114736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.114741:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219968 00000100:00080000:2.0:1782487586.114770:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487586.114779:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219840 00000100:00100000:3.0:1782487586.114782:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219840 00000100:00100000:3.0:1782487586.114816:0:190299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00080000:2.0:1782487586.114816:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487586.114827:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299219968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487586.114873:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299219968:12345-0@lo:400:kworker.0 Request processed in 48us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.114880:0:190299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1782487586.114911:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44b4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299219968:0@lo:400:kworker.0 00000100:00100000:3.0:1782487586.114937:0:190299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1782487586.114944:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066299219840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487586.114984:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066299219840:12345-0@lo:400:kworker.0 Request processed in 41us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.114992:0:190299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1782487586.115009:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213536499346 time 7213536399346 state 0x1 ref 4 00000100:00100000:3.0:1782487586.115020:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+709:294532:x1869066294344448:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.115027:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.115200:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.115233:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e7cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299219584:0@lo:400:kworker.0 00000100:00100000:2.0:1782487586.115243:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066299219840:0@lo:400:kworker.0 00000100:00100000:1.0:1782487586.115274:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487586.115427:0:190291:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219584 00000100:00100000:2.0:1782487586.115432:0:190291:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219584 00000100:00100000:1.0:1782487586.115462:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487586.115468:0:190291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782487586.115473:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299219712:0@lo:400:kworker.0 00000100:00100000:2.0:1782487586.115477:0:190291:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782487586.115508:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487586.115543:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294344960 00000100:00100000:1.0:1782487586.115546:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294344960 00000100:00100000:1.0:1782487586.115582:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16207 00000100:00100000:2.0:1782487586.115583:0:190291:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299219584:12345-0@lo:400:kworker.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.115592:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+143:2361:x1869066294344960:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.115593:0:190291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1782487586.115793:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e7cf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299219584:0@lo:400:kworker.0 00000100:00100000:1.0:1782487586.115852:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2361:x1869066294344960:12345-192.168.202.21@tcp:2:touch.500 Request processed in 261us (1116us total) trans 8589940670 rc 0/0 00000100:00100000:1.0:1782487586.115861:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16207 00000100:00100000:1.0:1782487586.115893:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299219712 00000100:00100000:1.0:1782487586.115897:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299219712 00000100:00100000:1.0:1782487586.115918:0:213684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1782487586.115924:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299219712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782487586.115966:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299219712:12345-0@lo:400:kworker.0 Request processed in 42us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.115973:0:213684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1782487586.115992:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213536499346 time 7213537382672 state 0x0 ref 4 00000100:00100000:2.0:1782487586.116003:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299219712:0@lo:400:kworker.0 00000100:00100000:1.0:1782487586.116005:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+709:294529:x1869066294344576:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.116015:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.116026:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cfb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f43 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116060:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116070:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116079:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116094:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116102:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116110:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116185:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116195:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116215:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.116236:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3e:0x0]: returning size 0 00000004:00200000:1.0:1782487586.116240:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.116253:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116262:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116270:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116277:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116284:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116290:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.116295:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116302:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116314:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.116316:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.116320:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116326:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85cfbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116338:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116355:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116361:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116367:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.116370:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116377:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116386:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c9e2fd00) 00010000:00010000:1.0:1782487586.116389:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.116392:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116399:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85cfc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116426:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85cfb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f43 expref: 711 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116440:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f43 expref: 710 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.116448:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.116450:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.116453:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc 0) 00000100:00100000:1.0:1782487586.116491:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294529:x1869066294344576:12345-192.168.202.21@tcp:101:rm.500 Request processed in 489us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.116499:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27027 00000004:00010000:1.0:1782487586.116604:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476717f9 reply state 00000000fac93404 transno 8589956890 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.116629:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.116672:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294519:x1869066294344192:12345-192.168.202.21@tcp:36:touch.500 Request processed in 2905us (3894us total) trans 8589956890 rc 0/0 00000100:00100000:1.0:1782487586.116680:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27024 00010000:00010000:3.0:1782487586.117032:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85cfd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f3c expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117067:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117076:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117085:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117097:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117105:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117113:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.117120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.117147:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345088 00000100:00100000:3.0:1782487586.117151:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345088 00000100:00100000:2.0:1782487586.117180:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.117188:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1164 00000100:00100000:3.0:1782487586.117197:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+712:2361:x1869066294345088:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487586.117217:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.117232:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85cf7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f2e expref: 712 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117245:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487586.117249:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.117281:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:2361:x1869066294345088:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.117289:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1164 00010000:00010000:3.0:1782487586.117426:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117436:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117445:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.117464:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3f:0x0]: returning size 0 00000004:00200000:3.0:1782487586.117467:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487586.117477:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117486:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117495:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117501:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117508:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117516:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.117520:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117527:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117537:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.117540:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.117544:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117550:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85cfd7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117560:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117567:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117574:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117580:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.117584:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117591:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117604:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4a4c88a00) 00010000:00010000:3.0:1782487586.117628:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.117632:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117639:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85cfde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.117658:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294526:x1869066294344320:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.117669:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85cfd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f3c expref: 711 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117670:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.117681:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85cfec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f35 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117686:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f3c expref: 710 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.117694:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:3.0:1782487586.117701:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.117705:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547117200, rc 0) 00010000:00010000:2.0:1782487586.117732:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.117739:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294532:x1869066294344448:12345-192.168.202.21@tcp:101:rm.500 Request processed in 2719us (4759us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.117745:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.117750:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27026 00010000:00010000:2.0:1782487586.117760:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117770:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117776:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117783:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117837:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117850:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117857:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.117874:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3d:0x0]: returning size 0 00000004:00200000:2.0:1782487586.117876:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.117885:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117893:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117900:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117906:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117912:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117917:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.117920:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117927:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117934:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.117937:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.117940:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117946:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85cff3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117955:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117961:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117966:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117971:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.117974:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117980:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117986:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb56d889b00) 00010000:00010000:2.0:1782487586.117988:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.117991:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.117996:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85cffa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.118013:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85cfec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f35 expref: 711 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.118024:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f35 expref: 710 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.118032:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.118034:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.118036:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e9e00, rc 0) 00000100:00100000:2.0:1782487586.118060:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294526:x1869066294344320:12345-192.168.202.21@tcp:101:rm.500 Request processed in 4065us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.118067:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27025 00000100:00100000:2.0:1782487586.118072:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213536499346 time 7213537382672 state 0x2 ref 0 00000100:00100000:1.0:1782487586.118271:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345344 00000100:00100000:1.0:1782487586.118276:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345344 00000100:00100000:1.0:1782487586.118310:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5771 00000100:00100000:1.0:1782487586.118318:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294518:x1869066294345344:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.118865:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294518:x1869066294345344:12345-192.168.202.21@tcp:35:touch.500 Request processed in 542us (1680us total) trans 8589956891 rc 0/0 00000100:00100000:1.0:1782487586.118874:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5771 00000100:00100000:3.0:1782487586.119900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.120121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.120150:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345600 00000100:00100000:3.0:1782487586.120155:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345600 00000100:00100000:3.0:1782487586.120179:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213536499346 time 7213537382672 state 0x0 ref 1 00000100:00100000:3.0:1782487586.120191:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213537482672 time 7213537382672 state 0x1 ref 1 00000100:00100000:3.0:1782487586.120228:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213537482672 time 7213541617890 state 0x0 ref 1 00000100:00100000:3.0:1782487586.120240:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294519:x1869066294345600:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.120257:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.120273:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d008 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f58 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.120311:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d008 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f58 expref: 712 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.120325:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d008 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f58 expref: 712 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.120352:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:3.0:1782487586.120356:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.120360:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb55800, rc 0) 00000100:00100000:3.0:1782487586.120392:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+712:294519:x1869066294345600:12345-192.168.202.21@tcp:101:touch.500 Request processed in 153us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.120400:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27028 00000100:00100000:3.0:1782487586.120405:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213537482672 time 7213541617890 state 0x2 ref 0 00010000:00010000:2.0:1782487586.120574:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120583:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120600:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120631:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.120637:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120646:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120880:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.120885:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.120890:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.120898:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85cf83 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.121255:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345472 00000100:00100000:1.0:1782487586.121261:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345472 00000100:00100000:1.0:1782487586.121484:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1165 00000100:00100000:1.0:1782487586.121494:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:2360:x1869066294345472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.121506:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.121522:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85cfc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f43 expref: 711 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.121535:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.121538:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.121577:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:2360:x1869066294345472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 85us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.121592:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1165 00000100:00100000:2.0:1782487586.122017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.122057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.122106:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345728 00000100:00100000:3.0:1782487586.122111:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345728 00000100:00100000:3.0:1782487586.122148:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16208 00000100:00100000:3.0:1782487586.122157:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2363:x1869066294345728:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.122167:0:200304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.122182:0:200304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f5f expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487586.122215:0:200304:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x184f:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.122229:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.122234:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.122243:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 121 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.122259:0:200304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 121 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.122271:0:200304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e8600, rc 0) 00000100:00100000:3.0:1782487586.122297:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2363:x1869066294345728:12345-192.168.202.21@tcp:101:rm.500 Request processed in 142us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.122305:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16208 00000100:00100000:2.0:1782487586.122813:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294345984 00000100:00100000:2.0:1782487586.122818:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294345984 00000100:00100000:2.0:1782487586.122840:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213537482672 time 7213541617890 state 0x0 ref 1 00000100:00100000:2.0:1782487586.122851:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213541717890 time 7213541617890 state 0x1 ref 1 00000100:00100000:2.0:1782487586.122874:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213541717890 time 7213544264409 state 0x0 ref 1 00000100:00100000:2.0:1782487586.122885:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294526:x1869066294345984:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.122923:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1782487586.122939:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d001 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f35 expref: 710 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.122959:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85cecd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee1 expref: 709 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.122975:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85ce2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e7f expref: 708 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.122991:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85cdbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e63 expref: 707 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123003:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.123013:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.123030:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123041:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123051:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123066:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123073:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123081:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123193:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123215:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123224:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.123797:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2540, 64 off170752 00010000:00010000:2.0:1782487586.123878:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123888:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123898:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123906:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123914:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123921:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123936:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.123952:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123959:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123966:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123972:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.123976:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123984:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.123994:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb56d889d00) 00010000:00010000:2.0:1782487586.123998:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.124002:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124008:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d024 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124023:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124030:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124037:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124043:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.124047:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124053:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124062:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.124064:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.124068:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.124074:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d016 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.124089:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008893393f reply state 000000006cde2648 transno 8589956892 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.124096:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.124151:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+708:294526:x1869066294345984:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1267us (2093us total) trans 8589956892 rc 0/0 00000100:00100000:2.0:1782487586.124160:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27029 00000100:00100000:2.0:1782487586.124165:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213541717890 time 7213544264409 state 0x2 ref 0 00010000:00010000:3.0:1782487586.124457:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.124463:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.124471:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.124475:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.124484:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.124495:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3d:0x0].0x0 (ffff9cb56d889d00) 00010000:00010000:3.0:1782487586.124498:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.124502:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.124509:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d02b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.124526:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.124530:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.124532:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487586.124998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.125060:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294346112 00000100:00100000:1.0:1782487586.125066:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294346112 00000100:00100000:1.0:1782487586.125111:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16209 00000100:00100000:1.0:1782487586.125120:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2362:x1869066294346112:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.125472:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2362:x1869066294346112:12345-192.168.202.21@tcp:2:touch.500 Request processed in 352us (474us total) trans 8589940008 rc 0/0 00000100:00100000:1.0:1782487586.125481:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16209 00010000:00010000:1.0:1782487586.125859:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125868:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125875:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125882:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.125886:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125894:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125906:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb56d889800) 00010000:00010000:1.0:1782487586.125909:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.125912:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.125919:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d01d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.126909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.127009:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294346368 00000100:00100000:1.0:1782487586.127014:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294346368 00000100:00100000:1.0:1782487586.127038:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213541717890 time 7213544264409 state 0x0 ref 1 00000100:00100000:1.0:1782487586.127051:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213544364409 time 7213544264409 state 0x1 ref 1 00000100:00100000:1.0:1782487586.127103:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213544364409 time 7213548493541 state 0x0 ref 1 00000100:00100000:1.0:1782487586.127115:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+707:294516:x1869066294346368:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.127160:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.127178:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85ce10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e78 expref: 707 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127200:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85cd61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e47 expref: 706 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127224:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:1.0:1782487586.127234:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.127251:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127263:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127273:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127289:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127297:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127305:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127421:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127430:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.127438:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.127932:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2541, 64 off170816 00010000:00010000:1.0:1782487586.128003:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128014:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128023:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128032:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128039:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128046:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128065:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.128081:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128087:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128094:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128100:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.128105:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128112:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128122:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:1.0:1782487586.128125:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.128129:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128135:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d040 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128150:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128157:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128164:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128170:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.128174:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128180:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128190:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.128193:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.128197:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.128214:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d032 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.128229:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cebf2470 reply state 00000000fa3ce7f1 transno 8589956893 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.128238:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.128297:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+707:294516:x1869066294346368:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1182us (1389us total) trans 8589956893 rc 0/0 00000100:00100000:1.0:1782487586.128306:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27030 00000100:00100000:1.0:1782487586.128311:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213544364409 time 7213548493541 state 0x2 ref 0 00010000:00010000:2.0:1782487586.128380:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.128388:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.128395:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.128399:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.128407:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.128419:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3b:0x0].0x0 (ffff9cb4c9e2f900) 00010000:00010000:2.0:1782487586.128422:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.128426:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.128433:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d047 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.128452:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.128456:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.128459:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487586.128909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.129255:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294346624 00000100:00100000:3.0:1782487586.129261:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294346624 00000100:00100000:3.0:1782487586.129305:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5772 00000100:00100000:3.0:1782487586.129315:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+707:294519:x1869066294346624:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.129545:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+708:294519:x1869066294346624:12345-192.168.202.21@tcp:35:touch.500 Request processed in 232us (638us total) trans 8589956894 rc 0/0 00000100:00100000:3.0:1782487586.129554:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5772 00000100:00100000:2.0:1782487586.132526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.132559:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294346880 00000100:00100000:2.0:1782487586.132565:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294346880 00000100:00100000:2.0:1782487586.132594:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213544364409 time 7213548493541 state 0x0 ref 1 00000100:00100000:2.0:1782487586.132669:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213548593541 time 7213548493541 state 0x1 ref 1 00000100:00100000:2.0:1782487586.132696:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213548593541 time 7213554085919 state 0x0 ref 1 00000100:00100000:2.0:1782487586.132708:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+708:294517:x1869066294346880:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.132728:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.132745:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d04e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f66 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132839:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132849:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132856:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132863:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.132867:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.132876:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132880:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.132890:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132895:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4c9e2fd00) 00010000:00010000:3.0:1782487586.132898:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.132900:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132903:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.132910:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d039 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.132914:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.132921:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.132932:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.133409:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1877:0x0], index 0: 0 00010000:00010000:2.0:1782487586.133558:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d063 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133569:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d063 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133577:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d063 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133631:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133639:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133646:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133652:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.133656:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133664:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133675:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.133678:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.133683:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133689:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d055 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.133702:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036aa34c9 reply state 000000000189b405 transno 8589956895 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.133711:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.133736:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d04e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f66 expref: 710 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133750:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d063 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f66 expref: 709 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.133758:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb56d889d00) 00010000:00010000:2.0:1782487586.133761:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.133764:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71600, rc 0) 00000100:00100000:2.0:1782487586.133826:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294517:x1869066294346880:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1120us (1305us total) trans 8589956895 rc 0/0 00000100:00100000:2.0:1782487586.133835:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27031 00000100:00100000:2.0:1782487586.133841:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213548593541 time 7213554085919 state 0x2 ref 0 00010000:00010000:3.0:1782487586.135447:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135458:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135465:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135472:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.135476:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135484:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135495:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb56d889b00) 00010000:00010000:3.0:1782487586.135498:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.135502:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.135510:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d05c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.136501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.136569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.136834:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294347392 00000100:00100000:3.0:1782487586.136841:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294347392 00000100:00100000:3.0:1782487586.136871:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213548593541 time 7213554085919 state 0x0 ref 1 00000100:00100000:3.0:1782487586.136884:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213554185919 time 7213554085919 state 0x1 ref 1 00000100:00100000:3.0:1782487586.136911:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294347264 00000100:00100000:3.0:1782487586.136914:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294347264 00000100:00100000:3.0:1782487586.136928:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213554185919 time 7213554085919 state 0x1 ref 2 00000100:00100000:3.0:1782487586.136948:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558438748 time 7213558338748 state 0x1 ref 2 00000100:00100000:3.0:1782487586.136960:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294517:x1869066294347392:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487586.137005:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.137022:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d063 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f66 expref: 710 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137039:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb56d889d00) 00010000:00010000:3.0:1782487586.137049:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.137109:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137122:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137131:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.137254:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca145307 reply state 00000000e84a6e93 transno 8589956896 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.137264:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.137332:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+711:294517:x1869066294347392:12345-192.168.202.21@tcp:36:touch.500 Request processed in 374us (835us total) trans 8589956896 rc 0/0 00000100:00100000:3.0:1782487586.137353:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27032 00000100:00100000:3.0:1782487586.137375:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558438748 time 7213558764964 state 0x0 ref 1 00000100:00100000:3.0:1782487586.137385:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+710:294530:x1869066294347264:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.137394:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.137406:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d078 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f6d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137493:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137504:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137513:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137528:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137536:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.137548:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.138086:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1851:0x0], index 1: 0 00010000:00010000:3.0:1782487586.138238:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d08d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138248:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138256:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138281:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138289:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138296:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138302:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.138307:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138315:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138325:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.138328:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.138333:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138340:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d07f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.138351:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006123cbc3 reply state 000000003eec029c transno 8589956897 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.138358:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.138381:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d078 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f6d expref: 713 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138395:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d08d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f6d expref: 712 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.138403:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:3.0:1782487586.138406:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.138409:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd06a00, rc 0) 00000100:00100000:3.0:1782487586.138440:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+713:294530:x1869066294347264:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1056us (1872us total) trans 8589956897 rc 0/0 00000100:00100000:3.0:1782487586.138448:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27033 00000100:00100000:3.0:1782487586.138454:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558438748 time 7213558764964 state 0x2 ref 0 00010000:00010000:3.0:1782487586.142481:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142496:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142504:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142512:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.142517:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142525:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142541:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb4a4c88a00) 00010000:00010000:3.0:1782487586.142544:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.142549:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142556:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d071 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142630:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142638:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142644:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142650:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.142653:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142660:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142674:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb543a0d200) 00010000:00010000:3.0:1782487586.142677:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.142680:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.142686:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d086 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.142732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.142760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.142833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.143000:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294347520 00000100:00100000:1.0:1782487586.143009:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294347520 00000100:00100000:1.0:1782487586.143040:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294347904 00000100:00100000:1.0:1782487586.143042:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294347904 00000100:00100000:1.0:1782487586.143071:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558438748 time 7213558764964 state 0x0 ref 1 00000100:00100000:1.0:1782487586.143084:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558864964 time 7213558764964 state 0x1 ref 1 00000100:00100000:1.0:1782487586.143113:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348032 00000100:00100000:1.0:1782487586.143116:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348032 00000100:00100000:1.0:1782487586.143129:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213558864964 time 7213558764964 state 0x1 ref 2 00000100:00100000:1.0:1782487586.143146:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213564636732 time 7213564536732 state 0x1 ref 2 00000100:00100000:1.0:1782487586.143158:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+713:294531:x1869066294347904:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.143180:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.143195:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d09b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f7b expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143349:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143363:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143373:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143388:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143396:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.143405:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.143876:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1878:0x0], index 0: 0 00010000:00010000:1.0:1782487586.144039:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d0b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144048:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144057:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d0b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144084:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144091:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144099:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144105:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d36a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.144110:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144117:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144127:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.144130:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.144134:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144140:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d0a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.144154:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008db0d246 reply state 0000000009265196 transno 8589956898 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.144163:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.144187:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d09b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f7b expref: 716 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144215:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d0b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f7b expref: 715 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144224:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:1.0:1782487586.144227:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.144229:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5476fda00, rc 0) 00000100:00100000:1.0:1782487586.144286:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+716:294531:x1869066294347904:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1129us (1525us total) trans 8589956898 rc 0/0 00000100:00100000:1.0:1782487586.144296:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27034 00000100:00100000:1.0:1782487586.144321:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213564636732 time 7213565711643 state 0x0 ref 1 00000100:00100000:1.0:1782487586.144332:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+715:294530:x1869066294348032:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.144356:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.144371:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d08d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f6d expref: 715 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144383:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb543a0d300) 00010000:00010000:1.0:1782487586.144391:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.144439:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144448:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144456:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.144523:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060c9711e reply state 000000005df1e934 transno 8589956899 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.144531:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.144569:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+716:294530:x1869066294348032:12345-192.168.202.21@tcp:36:touch.500 Request processed in 238us (1737us total) trans 8589956899 rc 0/0 00000100:00100000:1.0:1782487586.144577:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27035 00000100:00100000:1.0:1782487586.144582:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213564636732 time 7213565711643 state 0x2 ref 0 00000100:00100000:1.0:1782487586.144641:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213564636732 time 7213565711643 state 0x0 ref 1 00000100:00100000:1.0:1782487586.144650:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213565811643 time 7213565711643 state 0x1 ref 1 00000100:00100000:1.0:1782487586.144665:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213565811643 time 7213566056324 state 0x0 ref 1 00000100:00100000:1.0:1782487586.144676:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+715:294517:x1869066294347520:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.144685:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.144698:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85d0c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f74 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144726:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85d0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f74 expref: 716 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144737:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85d0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f74 expref: 716 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.144752:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.144755:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.144758:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474400a00, rc 0) 00000100:00100000:1.0:1782487586.144779:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+716:294517:x1869066294347520:12345-192.168.202.21@tcp:101:touch.500 Request processed in 105us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.144786:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27036 00000100:00100000:1.0:1782487586.144790:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213565811643 time 7213566056324 state 0x2 ref 0 00010000:00010000:1.0:1782487586.146763:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146781:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146790:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146796:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.146801:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146809:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146824:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c9e2fc00) 00010000:00010000:1.0:1782487586.146827:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.146832:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.146839:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d0a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.147160:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.147181:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147192:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147212:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147218:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.147221:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147227:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147237:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.147240:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.147243:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147249:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d0be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.147284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.147335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.147362:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348160 00000100:00100000:1.0:1782487586.147370:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348160 00000100:00100000:1.0:1782487586.147394:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213565811643 time 7213566056324 state 0x0 ref 1 00000100:00100000:1.0:1782487586.147404:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213566156324 time 7213566056324 state 0x1 ref 1 00000100:00100000:1.0:1782487586.147419:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348544 00000100:00100000:1.0:1782487586.147421:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348544 00000100:00100000:1.0:1782487586.147430:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213566156324 time 7213566056324 state 0x1 ref 2 00000100:00100000:1.0:1782487586.147444:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213568935424 time 7213568835424 state 0x1 ref 2 00000100:00100000:1.0:1782487586.147453:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+715:294530:x1869066294348160:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.147471:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.147486:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85d0cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f82 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.147513:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213568935424 time 7213568901131 state 0x0 ref 2 00010000:00010000:1.0:1782487586.147526:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85d0cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f82 expref: 716 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.147530:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+716:294531:x1869066294348544:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.147546:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85d0cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f82 expref: 716 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.147562:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:1.0:1782487586.147565:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.147568:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb474401600, rc 0) 00010000:00010000:2.0:1782487586.147569:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.147585:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d0b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f7b expref: 716 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147597:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:2.0:1782487586.147624:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.147628:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+715:294530:x1869066294348160:12345-192.168.202.21@tcp:101:touch.500 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.147636:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27037 00010000:00010000:2.0:1782487586.147672:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147682:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.147690:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.147794:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c813a7c reply state 00000000769bc32a transno 8589956900 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.147803:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.147848:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+716:294531:x1869066294348544:12345-192.168.202.21@tcp:36:touch.500 Request processed in 324us (512us total) trans 8589956900 rc 0/0 00000100:00100000:2.0:1782487586.147855:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27038 00000100:00100000:2.0:1782487586.147859:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213568935424 time 7213568901131 state 0x2 ref 0 00000100:00100000:3.0:1782487586.150004:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348288 00000100:00100000:3.0:1782487586.150013:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348288 00000100:00100000:3.0:1782487586.150092:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16210 00000100:00100000:3.0:1782487586.150102:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57651b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2363:x1869066294348288:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.150148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.150210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.150237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.150415:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57651b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2363:x1869066294348288:12345-192.168.202.21@tcp:2:touch.500 Request processed in 312us (3322us total) trans 8589940671 rc 0/0 00000100:00100000:3.0:1782487586.150424:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16210 00000100:00100000:3.0:1782487586.153159:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294349056 00000100:00100000:3.0:1782487586.153168:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294349056 00000100:00100000:3.0:1782487586.153218:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16211 00000100:00100000:3.0:1782487586.153228:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2362:x1869066294349056:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.153295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.153323:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348800 00000100:00100000:2.0:1782487586.153327:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348800 00000100:00100000:2.0:1782487586.153349:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213568935424 time 7213568901131 state 0x0 ref 1 00000100:00100000:2.0:1782487586.153361:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213569001131 time 7213568901131 state 0x1 ref 1 00000100:00100000:2.0:1782487586.153384:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294348928 00000100:00100000:2.0:1782487586.153387:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294348928 00000100:00100000:2.0:1782487586.153401:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213569001131 time 7213568901131 state 0x1 ref 2 00000100:00100000:2.0:1782487586.153417:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294349312 00000100:00100000:2.0:1782487586.153421:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294349312 00000100:00100000:2.0:1782487586.153434:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213569001131 time 7213568901131 state 0x1 ref 3 00000100:00100000:2.0:1782487586.153450:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213574940967 time 7213574840967 state 0x1 ref 3 00000100:00100000:2.0:1782487586.153461:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+717:294550:x1869066294348800:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.153473:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.153491:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d0da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f89 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.153551:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2362:x1869066294349056:12345-192.168.202.21@tcp:2:touch.500 Request processed in 323us (3312us total) trans 8589940009 rc 0/0 00000100:00100000:3.0:1782487586.153559:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16211 00010000:00010000:2.0:1782487586.153636:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.153652:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.153655:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575144337 time 7213575044337 state 0x1 ref 3 00010000:00010000:2.0:1782487586.153672:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.153673:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+718:294531:x1869066294348928:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.153685:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.153695:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.153698:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d0ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f90 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.153710:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.153720:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.153736:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d0ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f90 expref: 719 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.153750:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d0ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f90 expref: 719 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.153767:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb56d889800) 00010000:00010000:3.0:1782487586.153770:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.153773:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45653dc00, rc 0) 00000100:00100000:3.0:1782487586.153793:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+719:294531:x1869066294348928:12345-192.168.202.21@tcp:101:touch.500 Request processed in 122us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.153799:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27040 00000100:00100000:3.0:1782487586.153819:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575144337 time 7213575209324 state 0x0 ref 2 00000100:00100000:3.0:1782487586.153829:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1125:294551:x1869066294349312:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.153838:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.153847:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d0f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f97 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.153929:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154075:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154084:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154101:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154108:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154115:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.154176:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1852:0x0], index 1: 0 00010000:00010000:3.0:1782487586.154193:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d10b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154214:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d10b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154222:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d10b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.154233:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3a:0x0]: returning size 0 00010000:00010000:3.0:1782487586.154295:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154303:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154311:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154317:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.154322:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154329:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.154333:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d119 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.154348:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.154357:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154400:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.154404:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.154408:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154415:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d0fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154429:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154436:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154443:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154449:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.154453:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154460:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154474:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb543a0d200) 00010000:00010000:3.0:1782487586.154477:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.154480:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.154487:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d104 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.154637:0:190322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d6c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190322:1869066299220096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782487586.154677:0:190322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487586.154707:0:190322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487586.154741:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154749:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154756:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154762:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.154766:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154773:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154784:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb56d889800) 00010000:00010000:1.0:1782487586.154787:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.154790:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.154796:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d0d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.154843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.154924:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294349568 00000100:00100000:1.0:1782487586.154928:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294349568 00000100:00100000:1.0:1782487586.155070:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5773 00000100:00100000:1.0:1782487586.155079:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+719:294517:x1869066294349568:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.155260:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+720:294517:x1869066294349568:12345-192.168.202.21@tcp:35:touch.500 Request processed in 182us (418us total) trans 8589956903 rc 0/0 00000100:00100000:1.0:1782487586.155267:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5773 00010000:00010000:2.0:1782487586.155664:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.155673:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.155678:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.155686:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.155695:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.155699:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.155707:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.155717:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.155720:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.155723:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.155729:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d0e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.155741:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e922674 reply state 000000009b80f28c transno 8589956901 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.155749:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.155765:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294349824 00000100:00100000:2.0:1782487586.155769:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294349824 00010000:00010000:3.0:1782487586.155774:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d0f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f97 expref: 1128 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.155808:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5774 00000100:00100000:2.0:1782487586.155818:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+720:294530:x1869066294349824:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487586.155904:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d10b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f97 expref: 1127 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.155913:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487586.155916:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.155927:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd7a000, rc 0) 00000100:00100000:3.0:1782487586.155944:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299220096 00000100:00100000:3.0:1782487586.155948:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299220096 00000100:00100000:3.0:1782487586.155974:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16212 00000100:00100000:3.0:1782487586.155982:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:190322:x1869066299220096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1782487586.156013:0:213224:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 6242 00000100:00100000:2.0:1782487586.159286:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+721:294530:x1869066294349824:12345-192.168.202.21@tcp:35:touch.500 Request processed in 3465us (3605us total) trans 8589956904 rc 0/0 00000100:00100000:2.0:1782487586.159298:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5774 00010000:00010000:2.0:1782487586.159372:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d0da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f89 expref: 721 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.159392:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f89 expref: 720 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.159401:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb56d889b00) 00010000:00010000:2.0:1782487586.159404:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.159407:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70a00, rc 0) 00000100:00100000:3.0:1782487586.159628:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:190322:x1869066299220096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3646us (4950us total) trans 8589940010 rc 0/0 00000100:00100000:3.0:1782487586.159638:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16212 00000100:00100000:2.0:1782487586.159734:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+721:294550:x1869066294348800:12345-192.168.202.21@tcp:101:touch.500 Request processed in 6273us (9587us total) trans 8589956901 rc 0/0 00000100:00100000:2.0:1782487586.159743:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27039 00000100:00100000:1.0:1782487586.159775:0:190322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d6c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190322:1869066299220096:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782487586.159791:0:190322:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1852:0x0]-[0x280000400:0x1881:0x0] 00000100:00100000:3.0:1782487586.159858:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294551:x1869066294349312:12345-192.168.202.21@tcp:101:touch.500 Request processed in 6028us (6563us total) trans 8589956902 rc 0/0 00000100:00100000:3.0:1782487586.159870:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27041 00000100:00100000:3.0:1782487586.159877:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575144337 time 7213575209324 state 0x2 ref 0 00000100:00100000:1.0:1782487586.159954:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.160005:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294349952 00000100:00100000:3.0:1782487586.160010:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294349952 00000100:00100000:3.0:1782487586.160049:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16213 00000100:00100000:3.0:1782487586.160058:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2361:x1869066294349952:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.160273:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2361:x1869066294349952:12345-192.168.202.21@tcp:2:touch.500 Request processed in 216us (318us total) trans 8589940672 rc 0/0 00000100:00100000:3.0:1782487586.160281:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16213 00010000:00010000:3.0:1782487586.161466:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161478:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161486:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161493:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.161498:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161507:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161522:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb56d889d00) 00010000:00010000:3.0:1782487586.161525:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.161530:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.161537:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d0e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.162728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.162764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.162791:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294350336 00000100:00100000:2.0:1782487586.162799:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294350336 00000100:00100000:1.0:1782487586.162806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.162818:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294350592 00000100:00100000:3.0:1782487586.162825:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294350592 00000100:00100000:2.0:1782487586.162828:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575144337 time 7213575209324 state 0x0 ref 1 00000100:00100000:2.0:1782487586.162842:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575309324 time 7213575209324 state 0x1 ref 1 00000100:00100000:1.0:1782487586.162853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.162858:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213575309324 time 7213575209324 state 0x1 ref 2 00000100:00100000:2.0:1782487586.162868:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294350720 00000100:00100000:2.0:1782487586.162873:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294350720 00000100:00100000:1.0:1782487586.162881:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294350976 00000100:00100000:3.0:1782487586.162886:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213584375941 time 7213584275941 state 0x1 ref 2 00000100:00100000:1.0:1782487586.162886:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294350976 00000100:00100000:2.0:1782487586.162898:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213584375941 time 7213584275941 state 0x1 ref 3 00000100:00100000:3.0:1782487586.162902:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294551:x1869066294350336:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487586.162930:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5775 00000100:00100000:2.0:1782487586.162932:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213584421131 time 7213584321131 state 0x1 ref 3 00000100:00100000:2.0:1782487586.162947:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+722:294550:x1869066294350592:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487586.162957:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487586.162957:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57ed92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+722:294531:x1869066294350976:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:2.0:1782487586.162979:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.162983:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d10b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f97 expref: 1127 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.162999:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:2.0:1782487586.162999:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d119 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f89 expref: 722 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163006:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.163019:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb56d889b00) 00010000:00010000:2.0:1782487586.163030:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.163057:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163069:0:196437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 721 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163075:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163076:0:196437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163097:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163107:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163119:0:196437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 722 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163141:0:196437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 722 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.163158:0:196437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb560a04380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196437:1869066299220224:192.168.202.21@tcp:104: 00000004:00010000:2.0:1782487586.163218:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e860e8d8 reply state 00000000fc0e754e transno 8589956906 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.163228:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.163232:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57ed92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+723:294531:x1869066294350976:12345-192.168.202.21@tcp:35:touch.500 Request processed in 290us (377us total) trans 8589956905 rc 0/0 00000100:00100000:3.0:1782487586.163236:0:196437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450ece9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487586.163243:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5775 00000100:00100000:3.0:1782487586.163258:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213584421131 time 7213584648407 state 0x0 ref 3 00000100:00100000:3.0:1782487586.163270:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+723:294514:x1869066294350720:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:2.0:1782487586.163285:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+723:294550:x1869066294350592:12345-192.168.202.21@tcp:36:touch.500 Request processed in 340us (520us total) trans 8589956906 rc 0/0 00010000:00010000:3.0:1782487586.163292:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1782487586.163296:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27043 00010000:00010000:3.0:1782487586.163303:0:190298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 723 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163319:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85cd29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e39 expref: 723 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163329:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487586.163332:0:190298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163337:0:190298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163342:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163361:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.163367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.163383:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163395:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163403:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163451:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163459:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163468:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.163486:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294351232 00000100:00100000:2.0:1782487586.163491:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294351232 00000100:00100000:2.0:1782487586.163513:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213584748407 time 7213584648407 state 0x1 ref 3 00000100:00100000:2.0:1782487586.163541:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213584748407 time 7213584931972 state 0x0 ref 3 00000100:00100000:2.0:1782487586.163556:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1127:294552:x1869066294351232:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.163567:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.163577:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d143 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477f9e expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163626:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163633:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163638:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163647:0:190298:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.163655:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163704:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163715:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163724:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163736:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163744:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163751:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163839:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d15f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163854:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d15f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163862:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d15f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.163870:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3c:0x0]: returning size 0 00010000:00010000:2.0:1782487586.163927:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163935:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163942:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163948:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.163952:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163959:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163970:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.163973:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.163977:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.163984:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d151 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164000:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164007:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164013:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164018:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.164022:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164029:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164038:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.164041:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.164044:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164051:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d158 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164086:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d143 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f9e expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164100:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d15f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f9e expref: 1129 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.164113:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487586.164116:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.164119:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715acc00, rc 0) 00000100:00100000:2.0:1782487586.164157:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294552:x1869066294351232:12345-192.168.202.21@tcp:101:touch.500 Request processed in 603us (791us total) trans 8589956907 rc 0/0 00000100:00100000:2.0:1782487586.164164:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27045 00010000:00010000:2.0:1782487586.166317:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166329:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166337:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166343:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.166348:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166356:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166380:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb549170e00) 00010000:00010000:2.0:1782487586.166383:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.166387:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.166394:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d12e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166504:0:196437:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.21@tcp) returned -22 from blocking AST (req@00000000b220c85a x1869066299220224) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 720 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166520:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85ceb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ed3 expref: 720 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.166535:0:196437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb560a04380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:196437:1869066299220224:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487586.166556:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487586.166561:0:196437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166569:0:196437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166578:0:196437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166586:0:196437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.166592:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.166762:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fdaf45f reply state 000000006fff080b transno 8589956908 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.166770:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.167035:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294551:x1869066294350336:12345-192.168.202.21@tcp:36:touch.500 Request processed in 4136us (4310us total) trans 8589956908 rc 0/0 00000100:00100000:3.0:1782487586.167045:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27042 00000100:00100000:1.0:1782487586.167189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.167230:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294351360 00000100:00100000:2.0:1782487586.167237:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294351360 00000100:00100000:1.0:1782487586.167242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.167269:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294351616 00000100:00100000:2.0:1782487586.167270:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213585031972 time 7213584931972 state 0x1 ref 2 00000100:00100000:3.0:1782487586.167275:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294351616 00000100:00100000:3.0:1782487586.167296:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213585031972 time 7213584931972 state 0x1 ref 3 00000100:00100000:2.0:1782487586.167306:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213588795097 time 7213588695097 state 0x1 ref 3 00000100:00100000:2.0:1782487586.167320:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+720:294550:x1869066294351360:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:1.0:1782487586.167327:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213588795097 time 7213588715171 state 0x0 ref 3 00010000:00010000:2.0:1782487586.167337:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.167354:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294552:x1869066294351616:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.167387:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.167403:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d15f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f9e expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.167414:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85d16d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fa5 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167417:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.167425:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.167459:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85d16d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fa5 expref: 721 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167474:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.167475:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85d16d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fa5 expref: 721 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167498:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.167505:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:1.0:1782487586.167508:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.167518:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.167522:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb541391600, rc 0) 00010000:00010000:1.0:1782487586.167535:0:213935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167551:0:213935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.167561:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+721:294550:x1869066294351360:12345-192.168.202.21@tcp:101:touch.500 Request processed in 244us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.167566:0:213935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44f2b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220352:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487586.167574:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27046 00000100:00100000:1.0:1782487586.167656:0:213935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849480 going to sleep for 11 seconds 00010000:00010000:1.0:1782487586.167897:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167906:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167913:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167919:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.167924:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167935:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167947:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:1.0:1782487586.167950:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.167953:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167961:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167968:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.167993:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.168000:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d127 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.168061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.168065:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168086:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.168154:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294351744 00000100:00100000:1.0:1782487586.168160:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294351744 00000100:00100000:1.0:1782487586.168183:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213588815171 time 7213588715171 state 0x1 ref 3 00000100:00100000:1.0:1782487586.168221:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213588815171 time 7213589610521 state 0x0 ref 3 00000100:00100000:1.0:1782487586.168234:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1129:294551:x1869066294351744:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.168243:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.168254:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d17b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fac expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.168288:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d17b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fac expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.168299:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d36a00/0x66475b4e8b85d17b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fac expref: 1130 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.168486:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:1.0:1782487586.168490:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.168493:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d36a00, rc 0) 00000004:00080000:3.0:1782487586.168600:0:190298:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000bd1:0xb3a:0x0] is inserted into orphan list, open count = 1 00000100:00100000:1.0:1782487586.168630:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1130:294551:x1869066294351744:12345-192.168.202.21@tcp:101:touch.500 Request processed in 371us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.168640:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27048 00010000:00010000:3.0:1782487586.168807:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168816:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168823:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168829:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.168833:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168840:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168851:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:3.0:1782487586.168854:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.168857:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168864:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d14a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168879:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168885:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168957:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168966:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.168970:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168977:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.168989:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.168992:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.168996:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.169003:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d135 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.169016:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e68db7c reply state 000000001efd1df3 transno 8589956909 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.169024:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.169059:0:213935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44f2b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220352:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487586.169076:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+722:294514:x1869066294350720:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5806us (6270us total) trans 8589956909 rc 0/0 00010000:00010000:1.0:1782487586.169082:0:213935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.169091:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27044 00000100:00100000:2.0:1782487586.169649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.169688:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294351872 00000100:00100000:1.0:1782487586.169695:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294351872 00010000:00010000:2.0:1782487586.169703:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169713:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169719:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 722 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169720:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169734:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.169739:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169744:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169752:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487586.169755:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.169758:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169762:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d13c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.169768:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6148 00000100:00100000:1.0:1782487586.169781:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+721:2360:x1869066294351872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.169792:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.169799:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169822:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169840:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85ceaa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a477eda expref: 721 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169853:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.169858:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169866:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169873:0:192528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.169899:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.169934:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+720:2360:x1869066294351872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 157us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.169943:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6148 00010000:00010000:2.0:1782487586.169955:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.169963:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.169990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.170026:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294352000 00000100:00100000:1.0:1782487586.170032:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294352000 00000004:00010000:2.0:1782487586.170067:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc57b9fd reply state 0000000013deb30c transno 8589956910 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.170079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.170086:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16214 00000100:00100000:2.0:1782487586.170087:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.170099:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2363:x1869066294352000:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.170133:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294352128 00000100:00100000:3.0:1782487586.170137:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294352128 00000100:00100000:2.0:1782487586.170145:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294552:x1869066294351616:12345-192.168.202.21@tcp:36:touch.500 Request processed in 2804us (2904us total) trans 8589956910 rc 0/0 00000100:00100000:2.0:1782487586.170154:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27047 00000100:00100000:2.0:1782487586.170160:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213588815171 time 7213589610521 state 0x2 ref 0 00000100:00100000:3.0:1782487586.170168:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16215 00000100:00100000:3.0:1782487586.170177:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2361:x1869066294352128:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:1.0:1782487586.170301:0:195192:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1873:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782487586.170305:0:195192:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1873:0x0] updating lvb mtime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.170308:0:195192:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x1873:0x0] updating lvb atime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.170312:0:195192:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1873:0x0] updating lvb ctime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.170315:0:195192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1873:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782487586.170344:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2363:x1869066294352000:12345-192.168.202.21@tcp:2:touch.500 Request processed in 247us (355us total) trans 8589940673 rc 0/0 00000100:00100000:1.0:1782487586.170353:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16214 00000100:00100000:3.0:1782487586.170359:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2361:x1869066294352128:12345-192.168.202.21@tcp:2:touch.500 Request processed in 181us (289us total) trans 8589940011 rc 0/0 00000100:00100000:3.0:1782487586.170368:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16215 00000100:00100000:2.0:1782487586.170443:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.170477:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294352384 00000100:00100000:2.0:1782487586.170481:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294352384 00000100:00100000:2.0:1782487586.170499:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213588815171 time 7213589610521 state 0x0 ref 1 00000100:00100000:2.0:1782487586.170508:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213589710521 time 7213589610521 state 0x1 ref 1 00000100:00100000:3.0:1782487586.170521:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213589710521 time 7213591910003 state 0x0 ref 1 00000100:00100000:3.0:1782487586.170533:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+720:294528:x1869066294352384:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.170544:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.170554:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d182 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fb3 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170648:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170659:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170667:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170679:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170686:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.170692:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.170991:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1879:0x0], index 0: 0 00010000:00010000:3.0:1782487586.171113:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d197 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171122:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171130:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171155:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171162:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171168:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171173:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48c5e9e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.171177:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171183:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171196:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.171199:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.171213:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171220:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d189 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.171229:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4a30b1b reply state 00000000fbc8d3d8 transno 8589956911 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.171236:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.171254:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d182 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fb3 expref: 723 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171265:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d197 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fb3 expref: 722 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.171272:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:3.0:1782487586.171274:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.171277:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30600, rc 0) 00000100:00100000:3.0:1782487586.171314:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+723:294528:x1869066294352384:12345-192.168.202.21@tcp:101:touch.500 Request processed in 782us (872us total) trans 8589956911 rc 0/0 00000100:00100000:3.0:1782487586.171321:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27049 00000100:00100000:3.0:1782487586.171325:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213589710521 time 7213591910003 state 0x2 ref 0 00010000:00010000:1.0:1782487586.174785:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174798:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174806:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174812:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.174817:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174826:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174841:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.174845:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.174849:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.174855:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d174 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174933:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174953:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174960:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174966:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.174969:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174975:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174984:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb543a0d800) 00010000:00010000:3.0:1782487586.174987:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.174990:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.174997:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d190 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.176257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.176287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.176307:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294352512 00000100:00100000:2.0:1782487586.176307:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294352896 00000100:00100000:3.0:1782487586.176313:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294352512 00000100:00100000:2.0:1782487586.176314:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294352896 00000100:00100000:3.0:1782487586.176340:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213589710521 time 7213591910003 state 0x0 ref 1 00000100:00100000:3.0:1782487586.176350:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213592010003 time 7213591910003 state 0x1 ref 1 00000100:00100000:2.0:1782487586.176351:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5776 00000100:00100000:2.0:1782487586.176360:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294551:x1869066294352896:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.176367:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213592010003 time 7213597757861 state 0x0 ref 1 00000100:00100000:3.0:1782487586.176373:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1131:294552:x1869066294352512:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.176381:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.176394:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d1a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fba expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.176435:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fba expref: 1132 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.176446:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48c5e9e00/0x66475b4e8b85d1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fba expref: 1132 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.176461:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487586.176464:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.176466:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48c5e9e00, rc 0) 00000100:00100000:3.0:1782487586.176509:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1132:294552:x1869066294352512:12345-192.168.202.21@tcp:101:touch.500 Request processed in 134us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.176517:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27050 00000100:00100000:3.0:1782487586.176521:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213592010003 time 7213597757861 state 0x2 ref 0 00000004:00080000:2.0:1782487586.176648:0:190301:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0xb3a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782487586.176725:0:190301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2546, 64 off171136 00010000:00010000:2.0:1782487586.176771:0:190301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176781:0:190301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176789:0:190301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176799:0:190301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176804:0:190301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176810:0:190301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.176829:0:190301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.176850:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.176858:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.176867:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.176872:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.176873:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1132:294551:x1869066294352896:12345-192.168.202.21@tcp:35:touch.500 Request processed in 513us (583us total) trans 8589956912 rc 0/0 00010000:00010000:1.0:1782487586.176888:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.176890:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5776 00010000:00010000:1.0:1782487586.176904:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3a:0x0].0x0 (ffff9cb55a37b200) 00010000:00010000:1.0:1782487586.176907:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.176911:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.176917:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d1ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.176927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.176929:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.176933:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.176935:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487586.176962:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353024 00000100:00100000:3.0:1782487586.176967:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353024 00000100:00100000:2.0:1782487586.176980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.176996:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5777 00000100:00100000:3.0:1782487586.177003:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+722:294550:x1869066294353024:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.177023:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353152 00000100:00100000:1.0:1782487586.177028:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353152 00000100:00100000:2.0:1782487586.177045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.177047:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213592010003 time 7213597757861 state 0x0 ref 1 00000100:00100000:1.0:1782487586.177053:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213597857861 time 7213597757861 state 0x1 ref 1 00000100:00100000:1.0:1782487586.177073:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353408 00000100:00100000:1.0:1782487586.177075:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353408 00000100:00100000:2.0:1782487586.177083:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213597857861 time 7213598472154 state 0x0 ref 1 00000100:00100000:1.0:1782487586.177097:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213598572154 time 7213598472154 state 0x1 ref 2 00000100:00100000:1.0:1782487586.177110:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213598572154 time 7213598502009 state 0x0 ref 2 00000100:00100000:1.0:1782487586.177118:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+724:294528:x1869066294353408:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.177140:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.177154:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d197 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fb3 expref: 725 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.177165:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:1.0:1782487586.177172:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.177237:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.177248:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.177257:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.177266:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+724:294550:x1869066294353024:12345-192.168.202.21@tcp:35:touch.500 Request processed in 261us (337us total) trans 8589956913 rc 0/0 00000100:00100000:3.0:1782487586.177273:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5777 00000004:00010000:1.0:1782487586.177320:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071c7d550 reply state 0000000085efab88 transno 8589956914 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.177327:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.177362:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+725:294528:x1869066294353408:12345-192.168.202.21@tcp:36:touch.500 Request processed in 245us (318us total) trans 8589956914 rc 0/0 00000100:00100000:1.0:1782487586.177368:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27052 00000100:00100000:2.0:1782487586.178255:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+724:294520:x1869066294353152:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.178321:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.178362:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.178371:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d1ba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fc1 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178402:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178409:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178418:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178426:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178430:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178434:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178487:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178492:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178496:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.178510:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb3c:0x0]: returning size 0 00000004:00200000:2.0:1782487586.178513:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.178523:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178532:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178539:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178549:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178556:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178561:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.178565:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178572:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178580:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.178582:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.178584:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178588:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d1c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178595:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178599:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178602:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178624:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.178628:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178636:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178644:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb549170e00) 00010000:00010000:2.0:1782487586.178647:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.178650:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178654:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d1c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178674:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d1ba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc1 expref: 726 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178681:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc1 expref: 725 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.178686:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:2.0:1782487586.178688:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.178690:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196ce00, rc 0) 00000100:00100000:2.0:1782487586.178724:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+725:294520:x1869066294353152:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1630us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.178731:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27051 00000100:00100000:2.0:1782487586.178737:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213598572154 time 7213598502009 state 0x2 ref 0 00010000:00010000:1.0:1782487586.179044:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179053:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179060:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179067:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.179071:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179078:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179089:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487586.179093:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.179096:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.179103:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d1b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.179282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.179405:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353664 00000100:00100000:3.0:1782487586.179412:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353664 00000100:00100000:3.0:1782487586.179436:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213598572154 time 7213598502009 state 0x0 ref 1 00000100:00100000:3.0:1782487586.179446:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213598602009 time 7213598502009 state 0x1 ref 1 00000100:00100000:3.0:1782487586.179477:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213598602009 time 7213600867221 state 0x0 ref 1 00000100:00100000:3.0:1782487586.179489:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+724:294528:x1869066294353664:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.179500:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.179513:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85d1d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fc8 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.179601:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85d1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc8 expref: 725 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.179656:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85d1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc8 expref: 725 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.179712:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487586.179716:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.179719:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44fb74c00, rc 0) 00000100:00100000:2.0:1782487586.179750:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+725:294528:x1869066294353664:12345-192.168.202.21@tcp:101:touch.500 Request processed in 264us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.179763:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27053 00000100:00100000:2.0:1782487586.179767:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213598602009 time 7213600867221 state 0x2 ref 0 00000100:00100000:3.0:1782487586.180241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.180320:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353536 00000100:00100000:1.0:1782487586.180325:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353536 00000100:00100000:1.0:1782487586.180367:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16216 00000100:00100000:1.0:1782487586.180376:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2361:x1869066294353536:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:1.0:1782487586.180552:0:213693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1874:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782487586.180557:0:213693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1874:0x0] updating lvb mtime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.180560:0:213693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x1874:0x0] updating lvb atime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.180563:0:213693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1874:0x0] updating lvb ctime from disk: 1782487586 -> 1782487586 00002000:00010000:1.0:1782487586.180566:0:213693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1874:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782487586.180681:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+124:2361:x1869066294353536:12345-192.168.202.21@tcp:2:touch.500 Request processed in 233us (369us total) trans 8589940674 rc 0/0 00000100:00100000:1.0:1782487586.180690:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16216 00000100:00100000:2.0:1782487586.181140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.181178:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294353920 00000100:00100000:1.0:1782487586.181184:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294353920 00000100:00100000:1.0:1782487586.181213:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213598602009 time 7213600867221 state 0x0 ref 1 00000100:00100000:1.0:1782487586.181225:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213600967221 time 7213600867221 state 0x1 ref 1 00000100:00100000:1.0:1782487586.181250:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213600967221 time 7213602640654 state 0x0 ref 1 00000100:00100000:1.0:1782487586.181260:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+725:294520:x1869066294353920:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.181291:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.181311:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d1cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc1 expref: 725 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181336:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85cd8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e55 expref: 724 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181348:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.181353:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.181369:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181381:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181390:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181406:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181418:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181427:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181505:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181511:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.181516:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.181923:0:190299:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000bd1:0xb3c:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1782487586.182013:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182021:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182029:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182033:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.182037:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182042:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182054:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:1.0:1782487586.182056:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.182059:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182063:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d1eb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182073:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182077:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182082:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182085:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.182088:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182091:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182096:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.182098:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.182100:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.182104:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d1dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.182115:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082fb6dd2 reply state 00000000d1c2a328 transno 8589956915 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.182120:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.182157:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+725:294520:x1869066294353920:12345-192.168.202.21@tcp:36:rm.500 Request processed in 898us (1017us total) trans 8589956915 rc 0/0 00000100:00100000:1.0:1782487586.182163:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27054 00000100:00100000:1.0:1782487586.182167:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213600967221 time 7213602640654 state 0x2 ref 0 00000100:00100000:2.0:1782487586.182376:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.182403:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.182444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.182452:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294354304 00000100:00100000:3.0:1782487586.182456:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294354304 00000100:00100000:2.0:1782487586.182476:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294354560 00000100:00100000:2.0:1782487586.182481:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294354560 00000100:00100000:3.0:1782487586.182485:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16217 00000100:00100000:3.0:1782487586.182493:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2362:x1869066294354304:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.182520:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5778 00000100:00100000:2.0:1782487586.182530:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1132:294552:x1869066294354560:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.182711:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+147:2362:x1869066294354304:12345-192.168.202.21@tcp:2:touch.500 Request processed in 219us (307us total) trans 8589940675 rc 0/0 00000100:00100000:3.0:1782487586.182720:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16217 00000004:00080000:2.0:1782487586.182741:0:190301:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0xb3c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782487586.182811:0:190301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2547, 64 off171200 00010000:00010000:2.0:1782487586.182848:0:190301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182859:0:190301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182868:0:190301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182875:0:190301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182882:0:190301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182889:0:190301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.182902:0:190301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.182914:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487586.182916:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294354176 00000100:00100000:1.0:1782487586.182921:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294354176 00010000:00010000:3.0:1782487586.182923:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.182932:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.182936:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.182938:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213600967221 time 7213602640654 state 0x0 ref 1 00000100:00100000:2.0:1782487586.182946:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1134:294552:x1869066294354560:12345-192.168.202.21@tcp:35:touch.500 Request processed in 416us (500us total) trans 8589956916 rc 0/0 00000100:00100000:1.0:1782487586.182955:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213602740654 time 7213602640654 state 0x1 ref 1 00010000:00010000:3.0:1782487586.182956:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.182961:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5778 00010000:00010000:3.0:1782487586.182977:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3c:0x0].0x0 (ffff9cb4c9e2f300) 00010000:00010000:3.0:1782487586.182981:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.182984:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.182986:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213602740654 time 7213604375656 state 0x0 ref 1 00010000:00010000:3.0:1782487586.182999:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d1f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.183007:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1133:294558:x1869066294354176:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.183015:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.183019:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.183020:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.183023:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.183031:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d1f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fcf expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183103:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183113:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183121:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183134:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183142:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183149:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.183523:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1853:0x0], index 1: 0 00010000:00010000:1.0:1782487586.183704:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d20e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183712:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d20e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183718:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d20e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183747:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183754:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183761:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183766:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.183771:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183782:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183792:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.183794:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.183797:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183801:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d200 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.183810:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1decb23 reply state 00000000a5c91a00 transno 8589956917 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.183815:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.183835:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d1f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fcf expref: 1136 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183845:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d20e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fcf expref: 1135 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.183850:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487586.183852:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.183854:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71c00, rc 0) 00000100:00100000:1.0:1782487586.183881:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1136:294558:x1869066294354176:12345-192.168.202.21@tcp:101:touch.500 Request processed in 879us (1508us total) trans 8589956917 rc 0/0 00000100:00100000:1.0:1782487586.183886:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27055 00000100:00100000:1.0:1782487586.183890:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213602740654 time 7213604375656 state 0x2 ref 0 00000100:00100000:2.0:1782487586.184327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.184338:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.184348:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.184356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.184359:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.184366:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.184371:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.184378:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.184379:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294354816 00000100:00100000:2.0:1782487586.184385:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294354816 00010000:00010000:1.0:1782487586.184391:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb4664e1a00) 00010000:00010000:1.0:1782487586.184396:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.184400:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.184404:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213602740654 time 7213604375656 state 0x0 ref 1 00010000:00010000:1.0:1782487586.184409:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d1e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.184418:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213604475656 time 7213604375656 state 0x1 ref 1 00000100:00100000:2.0:1782487586.184441:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213604475656 time 7213605831308 state 0x0 ref 1 00000100:00100000:2.0:1782487586.184460:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+724:294537:x1869066294354816:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.184472:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.184481:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d21c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fd6 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184544:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184554:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184567:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184586:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184593:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.184600:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.185140:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294355072 00000100:00100000:3.0:1782487586.185145:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294355072 00000100:00100000:3.0:1782487586.185224:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5779 00010000:00010000:1.0:1782487586.185224:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.185232:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.185234:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+726:294528:x1869066294355072:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487586.185240:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.185246:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.185250:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.185254:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187a:0x0], index 0: 0 00010000:00010000:1.0:1782487586.185259:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.185271:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487586.185274:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.185278:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.185285:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71200/0x66475b4e8b85d207 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.185472:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+727:294528:x1869066294355072:12345-192.168.202.21@tcp:35:touch.500 Request processed in 241us (1118us total) trans 8589956918 rc 0/0 00000100:00100000:3.0:1782487586.185482:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5779 00010000:00010000:2.0:1782487586.185862:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d231 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185874:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185882:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185902:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185909:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185915:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185925:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.185929:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185935:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185943:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.185946:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.185949:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.185955:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d223 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.185964:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d397b151 reply state 000000000e23f155 transno 8589956919 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.185972:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.186001:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d21c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fd6 expref: 728 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.186012:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d231 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fd6 expref: 727 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.186019:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.186022:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.186024:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e600, rc 0) 00000100:00100000:2.0:1782487586.186056:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+728:294537:x1869066294354816:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1606us (1730us total) trans 8589956919 rc 0/0 00000100:00100000:2.0:1782487586.186063:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27056 00000100:00100000:2.0:1782487586.186068:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213604475656 time 7213605831308 state 0x2 ref 0 00000100:00100000:3.0:1782487586.187346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.187414:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.187423:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.187431:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.187438:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.187442:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.187450:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.187466:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb549170e00) 00010000:00010000:1.0:1782487586.187470:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782487586.187472:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294355328 00010000:00010000:1.0:1782487586.187474:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.187479:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294355328 00010000:00010000:1.0:1782487586.187484:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d22a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.187511:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213604475656 time 7213605831308 state 0x0 ref 1 00000100:00100000:2.0:1782487586.187521:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213605931308 time 7213605831308 state 0x1 ref 1 00000100:00100000:2.0:1782487586.187543:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213605931308 time 7213608933277 state 0x0 ref 1 00000100:00100000:2.0:1782487586.187553:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1135:294558:x1869066294355328:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.187585:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.187599:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71c00/0x66475b4e8b85d20e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fcf expref: 1135 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.187639:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487586.187650:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.187708:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.187718:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.187726:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.187798:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ee4d27e reply state 0000000021a5c3ac transno 8589956920 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.187812:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.187856:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1136:294558:x1869066294355328:12345-192.168.202.21@tcp:36:touch.500 Request processed in 305us (513us total) trans 8589956920 rc 0/0 00000100:00100000:2.0:1782487586.187863:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27057 00000100:00100000:2.0:1782487586.187867:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213605931308 time 7213608933277 state 0x2 ref 0 00000100:00100000:1.0:1782487586.189735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.189786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.189788:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294355584 00000100:00100000:2.0:1782487586.189794:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294355584 00000100:00100000:2.0:1782487586.189814:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213605931308 time 7213608933277 state 0x0 ref 1 00000100:00100000:2.0:1782487586.189824:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213609033277 time 7213608933277 state 0x1 ref 1 00000100:00100000:2.0:1782487586.189843:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294355840 00000100:00100000:2.0:1782487586.189846:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294355840 00000100:00100000:2.0:1782487586.189856:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213609033277 time 7213608933277 state 0x1 ref 2 00000100:00100000:2.0:1782487586.189871:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213611362689 time 7213611262689 state 0x1 ref 2 00000100:00100000:2.0:1782487586.189880:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+728:294537:x1869066294355584:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487586.189903:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213611362689 time 7213611291247 state 0x0 ref 2 00000100:00100000:1.0:1782487586.189919:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+728:294529:x1869066294355840:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.189922:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.189938:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d231 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fd6 expref: 728 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.189948:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782487586.189953:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb549170000) 00010000:00010000:2.0:1782487586.189962:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.189967:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85cee9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ee8 expref: 727 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190002:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85ce4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e86 expref: 726 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190014:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190029:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190033:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85cded lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e71 expref: 725 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190041:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190050:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb549170100) 00010000:00010000:1.0:1782487586.190061:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.190078:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190094:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190102:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190116:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190124:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190132:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.190217:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efa7a45d reply state 00000000a0b9cbc5 transno 8589956921 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.190227:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.190270:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190280:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.190284:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+726:294537:x1869066294355584:12345-192.168.202.21@tcp:36:touch.500 Request processed in 402us (552us total) trans 8589956921 rc 0/0 00000100:00100000:2.0:1782487586.190292:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27058 00010000:00010000:1.0:1782487586.190302:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.190799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.190849:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294355968 00000100:00100000:2.0:1782487586.190854:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294355968 00000100:00100000:2.0:1782487586.190873:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213611391247 time 7213611291247 state 0x1 ref 2 00010000:00010000:1.0:1782487586.190873:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190889:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190897:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190905:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:2.0:1782487586.190908:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213611391247 time 7213612297788 state 0x0 ref 2 00010000:00010000:1.0:1782487586.190912:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.190919:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1136:294559:x1869066294355968:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.190923:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190930:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.190937:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb4c5d1a800) 00010000:00010000:2.0:1782487586.190940:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d262 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fdd expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190942:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.190948:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.190957:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d23f lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190975:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190985:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.190997:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191011:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191018:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191025:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191056:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191063:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191069:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191074:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.191078:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191084:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191091:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.191093:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.191097:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191103:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d269 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191112:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191118:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191123:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191129:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.191131:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191137:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191143:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb451f41600) 00010000:00010000:2.0:1782487586.191145:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.191148:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191153:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d270 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191172:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d262 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fdd expref: 1136 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191186:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.191188:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.191192:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d262 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fdd expref: 1136 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191213:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4da00, rc 0) 00000100:00100000:2.0:1782487586.191247:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1135:294559:x1869066294355968:12345-192.168.202.21@tcp:101:rm.500 Request processed in 330us (450us total) trans 0 rc 301/301 00000100:00100000:2.0:1782487586.191254:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27060 00000040:00080000:1.0:1782487586.191638:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2548, 64 off171264 00010000:00010000:1.0:1782487586.191716:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191727:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191736:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191744:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191752:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191764:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191788:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.191801:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191802:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.191810:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191812:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191829:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.191829:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191834:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191840:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.191844:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191846:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191861:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb556addd00) 00010000:00010000:1.0:1782487586.191861:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191866:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.191871:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191877:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3e:0x0].0x0 (ffff9cb556addd00) 00010000:00010000:2.0:1782487586.191878:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d277 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191883:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.191889:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191896:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.191898:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70800/0x66475b4e8b85d25b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.191899:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.191902:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.191924:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191936:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191943:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191948:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d70a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.191952:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191958:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.191967:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.191969:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.192076:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.192085:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d70a00/0x66475b4e8b85d24d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.192098:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005b97a72 reply state 000000000238f3cb transno 8589956922 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.192107:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.192148:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+727:294529:x1869066294355840:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2231us (2362us total) trans 8589956922 rc 0/0 00000100:00100000:1.0:1782487586.192157:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27059 00000100:00100000:1.0:1782487586.192162:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213611391247 time 7213612297788 state 0x2 ref 0 00000100:00100000:3.0:1782487586.192386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.192454:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.192487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.192515:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356096 00000100:00100000:2.0:1782487586.192518:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356352 00000100:00100000:3.0:1782487586.192520:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356096 00000100:00100000:2.0:1782487586.192524:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356352 00000100:00100000:3.0:1782487586.192562:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1151 00000100:00100000:2.0:1782487586.192573:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1152 00000100:00100000:3.0:1782487586.192575:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579c1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1136:2363:x1869066294356096:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:2.0:1782487586.192584:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1136:2362:x1869066294356352:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487586.192604:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.192627:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d27e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478023 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192656:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192670:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192678:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192690:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192698:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192705:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192761:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192769:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192776:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.192791:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb46:0x0]: returning size 0 00000004:00200000:2.0:1782487586.192795:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.192808:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192817:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192824:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192830:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192836:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192841:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.192844:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192850:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192857:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.192860:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.192863:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192869:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d285 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192880:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192885:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192891:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192896:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.192899:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192905:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192911:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb451f41500) 00010000:00010000:2.0:1782487586.192914:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.192916:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192921:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d28c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192944:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d27e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1138 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.192957:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1137 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.192964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.192971:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487586.192974:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.192976:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54151a000, rc 0) 00000100:00100000:2.0:1782487586.192999:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1137:2362:x1869066294356352:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 419us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.193005:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1152 00000100:00100000:2.0:1782487586.193623:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356224 00000100:00100000:2.0:1782487586.193628:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356224 00000100:00100000:2.0:1782487586.193645:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213611391247 time 7213612297788 state 0x0 ref 1 00000100:00100000:2.0:1782487586.193655:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213612397788 time 7213612297788 state 0x1 ref 1 00010000:00010000:1.0:1782487586.193655:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.193678:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356480 00000100:00100000:2.0:1782487586.193681:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356480 00000100:00100000:2.0:1782487586.193690:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213612397788 time 7213612297788 state 0x1 ref 2 00000100:00100000:2.0:1782487586.193704:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615194855 time 7213615094855 state 0x1 ref 2 00000100:00100000:2.0:1782487586.193712:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294558:x1869066294356224:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.193721:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.193734:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d29a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47801c expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193762:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d29a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47801c expref: 1139 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193773:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d29a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47801c expref: 1139 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193787:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb541321500) 00010000:00010000:2.0:1782487586.193790:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.193792:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45f92ca00, rc 0) 00000100:00100000:2.0:1782487586.193814:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4503e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1139:294558:x1869066294356224:12345-192.168.202.21@tcp:101:touch.500 Request processed in 103us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.193821:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27061 00000100:00100000:2.0:1782487586.193835:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615194855 time 7213615226025 state 0x0 ref 1 00000100:00100000:2.0:1782487586.193843:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294562:x1869066294356480:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.193850:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.193859:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d2a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47802a expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193887:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193896:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193899:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193905:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.193912:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193913:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193931:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193932:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193951:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.193953:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb4b6109000) 00010000:00010000:1.0:1782487586.193960:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.193965:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193970:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.193979:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.193980:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.193990:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d2b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a477fe4 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194014:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194018:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194026:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194033:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194035:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194045:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194116:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194124:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194130:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194176:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194176:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.194184:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194189:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194190:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194194:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.194199:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194212:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194229:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194232:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.194239:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.194243:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194248:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.194249:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d2a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194255:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.194261:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194265:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194269:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d2bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194276:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194283:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194287:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194295:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194303:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194303:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.194309:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194313:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.194320:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194321:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194338:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb541321200) 00010000:00010000:2.0:1782487586.194341:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.194345:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194345:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194359:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d2af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194366:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb541321200) 00010000:00010000:3.0:1782487586.194370:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.194373:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194380:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d2c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194381:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d2a1 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47802a expref: 1140 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194399:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.194402:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.194406:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d2a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47802a expref: 1140 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194418:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d2b6 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fe4 expref: 1140 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194423:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558d86800, rc 0) 00010000:00010000:3.0:1782487586.194433:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.194436:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.194441:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d2b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fe4 expref: 1139 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.194453:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454f51c00, rc -2) 00000100:00100000:3.0:1782487586.194486:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579c1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:2363:x1869066294356096:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1916us (2033us total) trans 0 rc -2/-2 00010000:00010000:1.0:1782487586.194488:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d246 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.194498:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1151 00000100:00100000:2.0:1782487586.194555:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1137:294562:x1869066294356480:12345-192.168.202.21@tcp:101:rm.500 Request processed in 708us (1592us total) trans 0 rc 301/301 00000100:00100000:1.0:1782487586.194556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.194566:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27062 00000100:00100000:2.0:1782487586.194570:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615194855 time 7213615226025 state 0x2 ref 0 00000100:00100000:2.0:1782487586.194590:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356608 00000100:00100000:2.0:1782487586.194594:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356608 00000100:00100000:2.0:1782487586.194625:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615194855 time 7213615226025 state 0x0 ref 1 00000100:00100000:2.0:1782487586.194632:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615326025 time 7213615226025 state 0x1 ref 1 00000100:00100000:2.0:1782487586.194650:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615326025 time 7213616041271 state 0x0 ref 1 00010000:00010000:1.0:1782487586.194657:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.194661:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+726:294537:x1869066294356608:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.194674:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.194684:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85d2cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478031 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194708:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85d2cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478031 expref: 727 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194718:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85d2cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478031 expref: 727 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.194726:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194733:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb541321800) 00010000:00010000:1.0:1782487586.194734:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.194740:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.194742:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.194744:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8dc00, rc 0) 00010000:00010000:1.0:1782487586.194746:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.194752:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.194761:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4664e1a00) 00000100:00100000:2.0:1782487586.194765:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+727:294537:x1869066294356608:12345-192.168.202.21@tcp:101:touch.500 Request processed in 105us (212us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487586.194766:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.194772:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.194777:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27063 00000100:00100000:2.0:1782487586.194783:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615326025 time 7213616041271 state 0x2 ref 0 00010000:00010000:1.0:1782487586.194790:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d254 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.194830:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.194861:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356864 00000100:00100000:3.0:1782487586.194866:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356864 00000100:00100000:3.0:1782487586.194883:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213615326025 time 7213616041271 state 0x0 ref 1 00000100:00100000:3.0:1782487586.194896:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616141271 time 7213616041271 state 0x1 ref 1 00000100:00100000:3.0:1782487586.194922:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616141271 time 7213616312291 state 0x0 ref 1 00000100:00100000:3.0:1782487586.194935:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+726:294541:x1869066294356864:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.195088:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.195100:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d2d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478038 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196125:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196138:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196147:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196163:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196170:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.196178:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.196844:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1854:0x0], index 1: 0 00010000:00010000:3.0:1782487586.197060:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d2e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197074:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197083:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197116:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197123:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197131:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197138:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.197142:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197150:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197161:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.197165:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.197169:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197176:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d2d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.197189:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad237b6f reply state 000000008ddd3ffc transno 8589956923 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.197198:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.197240:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d2d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478038 expref: 729 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197256:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478038 expref: 728 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.197265:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:3.0:1782487586.197268:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.197271:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07000, rc 0) 00000100:00100000:3.0:1782487586.197330:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+729:294541:x1869066294356864:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2397us (2500us total) trans 8589956923 rc 0/0 00000100:00100000:3.0:1782487586.197339:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27064 00000100:00100000:3.0:1782487586.197345:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616141271 time 7213616312291 state 0x2 ref 0 00010000:00010000:2.0:1782487586.201548:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.201558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.201564:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201572:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201579:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.201583:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201590:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201622:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb543a0de00) 00010000:00010000:2.0:1782487586.201626:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.201630:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201637:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d2e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.201637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.201660:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294356992 00000100:00100000:3.0:1782487586.201670:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294356992 00000100:00100000:2.0:1782487586.201677:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294357376 00000100:00100000:2.0:1782487586.201683:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294357376 00000100:00100000:2.0:1782487586.201707:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616141271 time 7213616312291 state 0x0 ref 1 00000100:00100000:2.0:1782487586.201720:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616412291 time 7213616312291 state 0x1 ref 1 00000100:00100000:3.0:1782487586.201730:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16218 00000100:00100000:3.0:1782487586.201742:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066294356992:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.201748:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213616412291 time 7213623136355 state 0x0 ref 1 00000100:00100000:2.0:1782487586.201760:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+728:294532:x1869066294357376:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.201884:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.201909:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85cfe5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f3c expref: 728 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201924:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85ce33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477eb7 expref: 727 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201935:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb549170b00) 00010000:00010000:2.0:1782487586.201942:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.201960:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201971:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201980:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.201995:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202002:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202009:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.202066:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294356992:12345-192.168.202.21@tcp:2:touch.500 Request processed in 325us (517us total) trans 8589940012 rc 0/0 00000100:00100000:3.0:1782487586.202076:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16218 00010000:00010000:2.0:1782487586.202105:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202113:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202120:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.202894:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2542, 64 off170880 00000100:00100000:1.0:1782487586.202894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.202960:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202970:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202978:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202986:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202992:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.202998:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203015:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.203029:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.203034:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203040:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.203043:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203050:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203058:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb541321100) 00010000:00010000:2.0:1782487586.203060:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.203064:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203069:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d30a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203081:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.203083:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.203085:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.203094:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.203101:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.203107:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203114:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203120:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.203123:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203129:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203135:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb3f:0x0].0x0 (ffff9cb541321100) 00010000:00010000:2.0:1782487586.203137:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.203140:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203145:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d303 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203158:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203165:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203170:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203175:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.203178:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203183:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203194:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.203196:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.203199:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.203234:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294357632 00000100:00100000:3.0:1782487586.203240:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294357632 00000100:00100000:3.0:1782487586.203260:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213623236355 time 7213623136355 state 0x1 ref 2 00010000:00010000:2.0:1782487586.203269:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d2f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.203284:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000048c8318 reply state 00000000345ab4ec transno 8589956924 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.203292:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.203298:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294357504 00000100:00100000:3.0:1782487586.203303:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294357504 00000100:00100000:3.0:1782487586.203323:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213623236355 time 7213623136355 state 0x1 ref 3 00000100:00100000:2.0:1782487586.203338:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+729:294532:x1869066294357376:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1580us (1733us total) trans 8589956924 rc 0/0 00000100:00100000:3.0:1782487586.203345:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213624834414 time 7213624734414 state 0x1 ref 3 00000100:00100000:2.0:1782487586.203358:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27065 00000100:00100000:2.0:1782487586.203378:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624834414 time 7213624768162 state 0x0 ref 2 00000100:00100000:2.0:1782487586.203388:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1137:294562:x1869066294357504:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.203399:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.203408:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d311 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47803f expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.203432:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+728:294541:x1869066294357632:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.203457:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203461:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.203469:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203477:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203479:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d2e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478038 expref: 728 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203497:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203501:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d700) 00010000:00010000:2.0:1782487586.203508:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203516:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203586:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.203680:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203691:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.203699:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.203781:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007191e808 reply state 000000003879058f transno 8589956925 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.203789:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.203834:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+729:294541:x1869066294357632:12345-192.168.202.21@tcp:36:touch.500 Request processed in 407us (942us total) trans 8589956925 rc 0/0 00000100:00100000:3.0:1782487586.203842:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27066 00010000:00010000:2.0:1782487586.203879:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203888:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203893:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203898:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.203902:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203908:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203917:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.203919:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.203922:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203928:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d318 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203938:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.203939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.203948:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203954:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203959:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.203962:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203968:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203975:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x3bf54fa8 (ffff9cb541321900) 00010000:00010000:2.0:1782487586.203977:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.203980:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.203985:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d31f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x3bf54fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.204007:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d311 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47803f expref: 1138 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.204015:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.204018:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.204022:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d311 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47803f expref: 1138 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.204031:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4800, rc 0) 00000100:00100000:2.0:1782487586.204065:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1137:294562:x1869066294357504:12345-192.168.202.21@tcp:101:rm.500 Request processed in 678us (969us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487586.204069:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294357760 00000100:00100000:2.0:1782487586.204074:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27067 00000100:00100000:3.0:1782487586.204076:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294357760 00000100:00100000:2.0:1782487586.204080:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624834414 time 7213624768162 state 0x2 ref 0 00000100:00100000:3.0:1782487586.204112:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16219 00000100:00100000:3.0:1782487586.204122:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+147:2363:x1869066294357760:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.207669:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2363:x1869066294357760:12345-192.168.202.21@tcp:2:touch.500 Request processed in 3542us (3724us total) trans 8589940676 rc 0/0 00000100:00100000:2.0:1782487586.207681:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16219 00000100:00100000:1.0:1782487586.210345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210398:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210411:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210418:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210425:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:1.0:1782487586.210427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210430:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210437:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.210443:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358016 00000100:00100000:1.0:1782487586.210445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210452:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb541321000) 00000100:00100000:3.0:1782487586.210453:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358016 00010000:00010000:2.0:1782487586.210458:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.210464:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210470:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d2fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.210501:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.210505:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5780 00000100:00100000:1.0:1782487586.210510:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358144 00010000:00010000:2.0:1782487586.210514:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210515:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358144 00000100:00100000:3.0:1782487586.210519:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1137:294558:x1869066294358016:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:2.0:1782487586.210523:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210530:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.210532:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210537:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624834414 time 7213624768162 state 0x0 ref 1 00000100:00100000:1.0:1782487586.210548:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624868162 time 7213624768162 state 0x1 ref 1 00010000:00010000:2.0:1782487586.210550:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210559:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d600) 00010000:00010000:2.0:1782487586.210561:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782487586.210562:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358272 00010000:00010000:2.0:1782487586.210564:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210565:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358272 00010000:00010000:2.0:1782487586.210570:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d326 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.210575:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624868162 time 7213624768162 state 0x1 ref 2 00000100:00100000:1.0:1782487586.210584:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358400 00000100:00100000:1.0:1782487586.210587:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358400 00000100:00100000:2.0:1782487586.210589:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358528 00000100:00100000:2.0:1782487586.210591:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358528 00000100:00100000:1.0:1782487586.210596:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624868162 time 7213624768162 state 0x1 ref 3 00000100:00100000:1.0:1782487586.210603:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358656 00000100:00100000:2.0:1782487586.210621:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624868162 time 7213624768162 state 0x1 ref 4 00000100:00100000:1.0:1782487586.210621:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358656 00000100:00100000:1.0:1782487586.210633:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213624868162 time 7213624768162 state 0x1 ref 5 00000100:00100000:2.0:1782487586.210697:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213632186429 time 7213632086429 state 0x1 ref 5 00000100:00100000:2.0:1782487586.210709:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+731:294543:x1869066294358144:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.210722:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.210738:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d32d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478046 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210780:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210793:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210813:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210827:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210834:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210841:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.210849:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294558:x1869066294358016:12345-192.168.202.21@tcp:35:touch.500 Request processed in 331us (506us total) trans 8589956926 rc 0/0 00000100:00100000:3.0:1782487586.210858:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5780 00000100:00100000:3.0:1782487586.210895:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213632384771 time 7213632284771 state 0x1 ref 5 00000100:00100000:3.0:1782487586.210908:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4b4fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+732:294541:x1869066294358272:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.210920:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.210935:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d342 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47804d expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210936:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210955:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.210967:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.210975:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d342 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47804d expref: 733 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.210988:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d342 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47804d expref: 733 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.210988:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb40:0x0]: returning size 0 00000004:00200000:2.0:1782487586.210994:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.211010:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d200) 00000004:00010000:2.0:1782487586.211011:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211016:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.211022:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07a00, rc 0) 00010000:00010000:2.0:1782487586.211025:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211034:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211040:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211049:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4b4fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+733:294541:x1869066294358272:12345-192.168.202.21@tcp:101:touch.500 Request processed in 140us (617us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.211049:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211063:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:3.0:1782487586.211065:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27069 00010000:00010000:2.0:1782487586.211067:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211074:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211082:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.211085:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.211088:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211092:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213632581106 time 7213632481106 state 0x1 ref 4 00010000:00010000:2.0:1782487586.211108:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d334 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211112:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4b4feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+732:294554:x1869066294358400:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.211123:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.211124:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211130:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211135:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d350 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478054 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211137:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211152:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.211155:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211160:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211167:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb541321f00) 00010000:00010000:2.0:1782487586.211169:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.211175:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211175:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211193:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d33b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211197:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211222:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211234:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d32d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478046 expref: 734 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211238:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211256:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211262:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478046 expref: 733 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211269:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211272:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.211278:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.211282:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481a00, rc 0) 00000100:00100000:2.0:1782487586.211304:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+733:294543:x1869066294358144:12345-192.168.202.21@tcp:101:rm.500 Request processed in 598us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.211310:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27068 00000100:00100000:2.0:1782487586.211326:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213632816252 time 7213632716252 state 0x1 ref 3 00000100:00100000:2.0:1782487586.211336:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+732:294555:x1869066294358528:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.211342:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.211350:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211353:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d36c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47805b expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211369:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211378:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211387:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211397:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.211398:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb42:0x0]: returning size 0 00000004:00200000:3.0:1782487586.211404:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.211410:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.211418:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211422:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211434:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211441:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211446:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211449:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211458:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211467:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211473:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.211477:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211484:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211496:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.211500:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.211500:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211505:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211512:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211514:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d357 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211526:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211533:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211541:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211548:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211554:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00000004:00200000:2.0:1782487586.211554:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb43:0x0]: returning size 0 00010000:00010000:3.0:1782487586.211558:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.211559:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.211569:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.211570:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211588:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211589:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb543a0d300) 00010000:00010000:3.0:1782487586.211595:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.211600:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211602:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211630:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211633:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d35e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211642:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211653:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b446e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.211656:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211662:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211668:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d350 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 734 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211672:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.211678:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.211682:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211689:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b446e00/0x66475b4e8b85d373 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211690:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 733 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211706:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:2.0:1782487586.211708:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211709:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.211713:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6a00, rc 0) 00010000:00010000:2.0:1782487586.211720:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211726:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211731:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.211735:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211741:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4b4feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+733:294554:x1869066294358400:12345-192.168.202.21@tcp:101:rm.500 Request processed in 631us (1292us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.211744:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211756:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27070 00010000:00010000:2.0:1782487586.211765:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb541321c00) 00010000:00010000:2.0:1782487586.211768:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.211770:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211775:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d37a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.211782:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213632816252 time 7213633171445 state 0x0 ref 2 00000100:00100000:3.0:1782487586.211795:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+733:294556:x1869066294358656:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.211799:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d36c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47805b expref: 733 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211804:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.211812:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47805b expref: 732 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211816:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85d388 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478062 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.211821:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:2.0:1782487586.211827:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.211830:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a35eda00, rc 0) 00000100:00100000:2.0:1782487586.211851:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+733:294555:x1869066294358528:12345-192.168.202.21@tcp:101:rm.500 Request processed in 518us (1382us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.211853:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.211860:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27071 00010000:00010000:3.0:1782487586.211868:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.211876:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212035:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212048:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.212057:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212091:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358784 00000100:00100000:2.0:1782487586.212096:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358784 00000100:00100000:1.0:1782487586.212108:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.212115:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213633271445 time 7213633171445 state 0x1 ref 2 00010000:00010000:3.0:1782487586.212121:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212129:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294358912 00010000:00010000:3.0:1782487586.212131:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212133:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294358912 00000100:00100000:1.0:1782487586.212143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.212144:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212148:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213633271445 time 7213633171445 state 0x1 ref 3 00000004:00200000:3.0:1782487586.212168:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb44:0x0]: returning size 0 00000100:00100000:2.0:1782487586.212168:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359040 00000100:00100000:2.0:1782487586.212173:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359040 00000004:00200000:3.0:1782487586.212174:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1782487586.212179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00010000:3.0:1782487586.212188:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212198:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.212227:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212234:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212241:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212250:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.212253:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212259:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1153 00010000:00010000:3.0:1782487586.212261:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212276:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:2.0:1782487586.212276:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+734:2360:x1869066294359040:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487586.212283:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.212288:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.212298:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d38f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212300:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.212311:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d3a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478077 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212314:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212330:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359168 00010000:00010000:3.0:1782487586.212331:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212334:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359168 00010000:00010000:3.0:1782487586.212342:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212348:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.212348:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212352:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213633271445 time 7213633171445 state 0x1 ref 4 00010000:00010000:3.0:1782487586.212355:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212360:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212362:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359296 00000100:00100000:1.0:1782487586.212366:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359296 00010000:00010000:3.0:1782487586.212367:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212370:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212375:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213633271445 time 7213633171445 state 0x1 ref 5 00010000:00010000:2.0:1782487586.212388:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212397:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb56d889b00) 00010000:00010000:2.0:1782487586.212398:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212400:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213633890431 time 7213633790431 state 0x1 ref 5 00010000:00010000:3.0:1782487586.212405:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.212411:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212412:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212412:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+737:294560:x1869066294358784:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.212423:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.212429:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d396 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212432:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d3b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478069 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212450:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212456:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212462:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212467:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212469:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586a00/0x66475b4e8b85d388 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478062 expref: 739 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212470:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551446000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.212474:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212478:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212495:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212498:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478062 expref: 738 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212503:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212519:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb56d889800) 00010000:00010000:2.0:1782487586.212522:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.212522:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.212523:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.212528:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f586400, rc 0) 00010000:00010000:2.0:1782487586.212528:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.212531:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212540:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.212546:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359552 00000100:00100000:3.0:1782487586.212551:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359552 00000100:00100000:3.0:1782487586.212580:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5781 00000100:00100000:3.0:1782487586.212589:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57ed92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+739:294537:x1869066294359552:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:2.0:1782487586.212593:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212598:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212602:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d3ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212622:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212633:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.212650:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb45:0x0]: returning size 0 00010000:00010000:2.0:1782487586.212653:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.212653:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.212659:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.212661:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212665:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212669:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212670:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.212673:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212676:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212679:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212682:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212688:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212692:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8ef95a8 (ffff9cb541321b00) 00010000:00010000:1.0:1782487586.212693:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.212694:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.212696:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212697:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212703:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d3b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212703:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212710:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.212712:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.212715:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212722:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d3a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478077 expref: 739 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212725:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d3c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212731:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.212733:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.212735:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212736:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d3a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478077 expref: 739 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212741:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212745:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54834c800, rc -2) 00010000:00010000:1.0:1782487586.212747:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212752:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.212755:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212761:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212767:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb556addd00) 00010000:00010000:1.0:1782487586.212769:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782487586.212773:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+738:2360:x1869066294359040:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 501us (630us total) trans 0 rc -2/-2 00010000:00010000:1.0:1782487586.212773:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212779:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85d3c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.212780:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1153 00010000:00010000:1.0:1782487586.212804:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d3b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478069 expref: 738 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212821:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478069 expref: 737 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.212828:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:1.0:1782487586.212831:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.212833:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c800, rc 0) 00000100:00100000:1.0:1782487586.212861:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+737:294560:x1869066294358784:12345-192.168.202.21@tcp:101:rm.500 Request processed in 450us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.212868:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27073 00000100:00100000:2.0:1782487586.212881:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634370856 time 7213634270856 state 0x1 ref 4 00000100:00100000:2.0:1782487586.212892:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294559:x1869066294358912:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.212901:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.212910:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d3d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478070 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212946:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212955:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212962:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212966:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213634456638 time 7213634356638 state 0x1 ref 4 00010000:00010000:2.0:1782487586.212975:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.212975:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+737:294563:x1869066294359168:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.212981:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.212988:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213018:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213025:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213030:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213036:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.213039:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213049:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213058:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.213060:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.213063:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213068:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d3dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213077:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213083:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213089:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213093:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.213096:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213102:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213108:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xb5064fa8 (ffff9cb541321100) 00010000:00010000:2.0:1782487586.213110:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.213113:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213119:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d3e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xb5064fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.213142:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57ed92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+737:294537:x1869066294359552:12345-192.168.202.21@tcp:35:touch.500 Request processed in 550us (849us total) trans 8589956927 rc 0/0 00010000:00010000:2.0:1782487586.213142:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d3d5 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478070 expref: 1139 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213159:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00000100:00100000:3.0:1782487586.213160:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5781 00010000:00010000:2.0:1782487586.213164:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.213169:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d3d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478070 expref: 1139 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213178:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551447e00, rc 0) 00000100:00100000:2.0:1782487586.213197:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294559:x1869066294358912:12345-192.168.202.21@tcp:101:rm.500 Request processed in 308us (1089us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487586.213253:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+736:294556:x1869066294358656:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1459us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.213266:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27074 00000100:00100000:3.0:1782487586.213276:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27072 00000100:00100000:2.0:1782487586.213284:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634456638 time 7213634674274 state 0x0 ref 2 00000100:00100000:2.0:1782487586.213296:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+735:294548:x1869066294359296:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.213303:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.213310:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d3ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478085 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213334:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213342:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213353:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213363:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213370:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213376:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213418:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213425:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213432:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.213448:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb41:0x0]: returning size 0 00000004:00200000:2.0:1782487586.213451:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.213459:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213467:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213474:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213484:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213490:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213495:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.213497:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213503:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213510:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.213512:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.213515:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213521:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d3f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213529:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213593:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213600:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213620:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.213625:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213632:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213640:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb541321700) 00010000:00010000:2.0:1782487586.213642:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.213645:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213651:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d3f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213671:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d3ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478085 expref: 737 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213681:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478085 expref: 736 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.213688:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.213690:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.213693:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07000, rc 0) 00000100:00100000:2.0:1782487586.213711:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+736:294548:x1869066294359296:12345-192.168.202.21@tcp:101:rm.500 Request processed in 418us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.213717:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27076 00010000:00010000:1.0:1782487586.214298:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.214309:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d406 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47807e expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214336:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214344:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214353:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214364:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214374:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214380:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214425:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214433:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214440:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.214470:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb46:0x0]: returning size 0 00000004:00200000:1.0:1782487586.214473:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.214481:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214489:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214497:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214503:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214509:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214519:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.214522:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214528:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214723:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.214726:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.214730:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214736:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d40d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214747:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214753:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214759:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214765:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.214767:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214773:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214785:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb556add500) 00010000:00010000:1.0:1782487586.214787:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.214790:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214796:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5476fda00/0x66475b4e8b85d414 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214875:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e600/0x66475b4e8b85d406 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47807e expref: 737 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214887:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47807e expref: 736 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.214894:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:1.0:1782487586.214897:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.214899:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71600, rc 0) 00000100:00100000:1.0:1782487586.214936:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+736:294563:x1869066294359168:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1961us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.214943:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27075 00000100:00100000:1.0:1782487586.214948:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634456638 time 7213634674274 state 0x2 ref 0 00000100:00100000:2.0:1782487586.215660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.215683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.215734:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359680 00000100:00100000:3.0:1782487586.215741:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359680 00000100:00100000:3.0:1782487586.215782:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359808 00000100:00100000:3.0:1782487586.215786:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359808 00000100:00100000:1.0:1782487586.215795:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16220 00000100:00100000:3.0:1782487586.215833:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16221 00000100:00100000:3.0:1782487586.215843:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2361:x1869066294359808:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.215884:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2362:x1869066294359680:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.215894:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.215908:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47808c expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.215933:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1876:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.215944:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.215948:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.215956:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 149 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.215969:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 149 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.215980:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70a00, rc 0) 00000100:00100000:1.0:1782487586.216037:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+149:2362:x1869066294359680:12345-192.168.202.21@tcp:101:rm.500 Request processed in 233us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.216043:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16220 00000100:00100000:3.0:1782487586.216104:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2361:x1869066294359808:12345-192.168.202.21@tcp:2:touch.500 Request processed in 262us (417us total) trans 8589940013 rc 0/0 00000100:00100000:3.0:1782487586.216115:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16221 00000100:00100000:2.0:1782487586.220013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.220060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.220095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.220109:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360192 00000100:00100000:1.0:1782487586.220117:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360192 00000100:00100000:3.0:1782487586.220148:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360064 00000100:00100000:3.0:1782487586.220154:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360064 00000100:00100000:1.0:1782487586.220165:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16222 00000100:00100000:1.0:1782487586.220176:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+150:2361:x1869066294360192:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.220191:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.220193:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16223 00000100:00100000:3.0:1782487586.220215:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+150:2361:x1869066294360064:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.220224:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.220225:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780a1 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.220238:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47809a expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.220250:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1877:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00002000:00010000:3.0:1782487586.220256:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1879:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.220266:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.220270:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.220271:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.220277:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.220284:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 152 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.220285:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 152 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.220312:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 152 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.220314:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 152 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.220338:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d70800, rc 0) 00010000:00010000:3.0:1782487586.220339:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f586a00, rc 0) 00000100:00100000:1.0:1782487586.220381:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+152:2361:x1869066294360192:12345-192.168.202.21@tcp:101:rm.500 Request processed in 207us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.220387:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16222 00000100:00100000:3.0:1782487586.220815:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2361:x1869066294360064:12345-192.168.202.21@tcp:101:rm.500 Request processed in 610us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.220823:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16223 00000100:00100000:3.0:1782487586.220856:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360448 00000100:00100000:3.0:1782487586.220861:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360448 00000100:00100000:3.0:1782487586.220885:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634456638 time 7213634674274 state 0x0 ref 1 00000100:00100000:3.0:1782487586.220897:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634774274 time 7213634674274 state 0x1 ref 1 00000100:00100000:3.0:1782487586.220928:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634774274 time 7213642317909 state 0x0 ref 1 00000100:00100000:3.0:1782487586.220941:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1138:294567:x1869066294360448:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.220954:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.220982:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d437 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780a8 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221120:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221134:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221145:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221162:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221171:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221178:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.221738:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187b:0x0], index 0: 0 00010000:00010000:3.0:1782487586.221927:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d44c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221938:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221946:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d44c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221981:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221989:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.221996:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222002:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.222007:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222015:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222033:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.222037:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.222041:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222048:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587000/0x66475b4e8b85d43e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.222062:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f586cad2 reply state 00000000be7e8237 transno 8589956928 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.222070:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.222097:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587200/0x66475b4e8b85d437 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a8 expref: 1141 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222113:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d44c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a8 expref: 1140 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.222121:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:3.0:1782487586.222124:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.222127:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587e00, rc 0) 00000100:00100000:3.0:1782487586.222162:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1141:294567:x1869066294360448:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1223us (2156us total) trans 8589956928 rc 0/0 00000100:00100000:3.0:1782487586.222171:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27077 00000100:00100000:3.0:1782487586.222177:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634774274 time 7213642317909 state 0x2 ref 0 00000100:00100000:2.0:1782487586.222290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.222350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.222434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.222463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.222488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.222515:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360576 00000100:00100000:1.0:1782487586.222521:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360576 00000100:00100000:2.0:1782487586.222536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.222564:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360704 00000100:00100000:2.0:1782487586.222567:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294360960 00000100:00100000:1.0:1782487586.222568:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360704 00000100:00100000:2.0:1782487586.222574:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294360960 00000100:00100000:1.0:1782487586.222587:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294359936 00000100:00100000:1.0:1782487586.222590:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294359936 00000100:00100000:2.0:1782487586.222600:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213634774274 time 7213642317909 state 0x0 ref 1 00000100:00100000:1.0:1782487586.222623:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294361088 00000100:00100000:1.0:1782487586.222626:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294361088 00000100:00100000:2.0:1782487586.222637:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213642417909 time 7213642317909 state 0x1 ref 1 00000100:00100000:1.0:1782487586.222648:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16224 00000100:00100000:1.0:1782487586.222656:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2361:x1869066294360576:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:2.0:1782487586.222661:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213642417909 time 7213644050644 state 0x0 ref 1 00010000:00010000:1.0:1782487586.222667:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.222675:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+736:294538:x1869066294360960:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.222681:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780af expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.222688:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.222701:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d461 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780bd expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.222702:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1851:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.222717:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.222721:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.222729:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222742:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222752:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71c00, rc 0) 00000100:00100000:1.0:1782487586.222778:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2361:x1869066294360576:12345-192.168.202.21@tcp:101:rm.500 Request processed in 123us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.222784:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16224 00010000:00010000:2.0:1782487586.222791:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.222801:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.222801:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16225 00010000:00010000:2.0:1782487586.222812:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.222822:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2361:x1869066294360704:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.222833:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.222841:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222846:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780b6 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.222852:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.222861:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1852:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.222863:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222873:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.222877:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.222883:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222894:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.222908:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578d71200, rc 0) 00000100:00100000:1.0:1782487586.222925:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2361:x1869066294360704:12345-192.168.202.21@tcp:101:rm.500 Request processed in 106us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.222932:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16225 00000100:00100000:1.0:1782487586.222944:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16226 00000100:00100000:1.0:1782487586.222951:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2363:x1869066294359936:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.222957:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.222967:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478093 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.222979:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1850:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.222987:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.222990:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.222995:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.223007:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 128 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.223016:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5476fda00, rc 0) 00000100:00100000:1.0:1782487586.223033:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2363:x1869066294359936:12345-192.168.202.21@tcp:101:rm.500 Request processed in 83us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.223038:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16226 00000100:00100000:1.0:1782487586.223050:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16227 00000100:00100000:1.0:1782487586.223056:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2363:x1869066294361088:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.223062:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.223186:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780c4 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.223212:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1878:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.223222:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.223225:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.223231:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 152 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.223242:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 152 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.223252:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e600, rc 0) 00000100:00100000:1.0:1782487586.223272:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+152:2363:x1869066294361088:12345-192.168.202.21@tcp:101:rm.500 Request processed in 217us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.223278:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16227 00000004:00080000:2.0:1782487586.223295:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1855:0x0], index 1: 0 00010000:00010000:2.0:1782487586.223423:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d48b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223434:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d48b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223442:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d48b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223468:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223475:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223481:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223487:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.223491:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223502:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223512:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.223515:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.223519:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223525:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d468 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.223539:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dc3f887 reply state 0000000044ad0da2 transno 8589956929 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.223547:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.223570:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d461 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780bd expref: 739 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223585:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d48b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780bd expref: 738 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.223593:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb541321100) 00010000:00010000:2.0:1782487586.223596:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.223598:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00000100:00100000:2.0:1782487586.223655:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+739:294538:x1869066294360960:12345-192.168.202.21@tcp:101:touch.500 Request processed in 982us (1220us total) trans 8589956929 rc 0/0 00000100:00100000:2.0:1782487586.223663:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27078 00000100:00100000:2.0:1782487586.223668:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213642417909 time 7213644050644 state 0x2 ref 0 00000100:00100000:3.0:1782487586.224188:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294361344 00000100:00100000:3.0:1782487586.224193:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294361344 00000100:00100000:3.0:1782487586.224294:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5782 00000100:00100000:3.0:1782487586.224304:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+739:294541:x1869066294361344:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.224812:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+740:294541:x1869066294361344:12345-192.168.202.21@tcp:35:touch.500 Request processed in 508us (2275us total) trans 8589956930 rc 0/0 00000100:00100000:3.0:1782487586.224821:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5782 00010000:00010000:3.0:1782487586.225093:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225102:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225110:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225116:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.225120:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225128:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225141:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb4a4c88a00) 00010000:00010000:3.0:1782487586.225155:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.225159:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225167:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d445 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225983:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225992:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.225998:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226004:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.226008:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226015:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226027:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb541321700) 00010000:00010000:3.0:1782487586.226030:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.226034:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226040:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d46f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.226165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.226250:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294361600 00000100:00100000:3.0:1782487586.226257:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294361600 00000100:00100000:3.0:1782487586.226283:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213642417909 time 7213644050644 state 0x0 ref 1 00000100:00100000:3.0:1782487586.226293:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213644150644 time 7213644050644 state 0x1 ref 1 00000100:00100000:3.0:1782487586.226358:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213644150644 time 7213647747823 state 0x0 ref 1 00000100:00100000:3.0:1782487586.226372:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1140:294567:x1869066294361600:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487586.226413:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.226432:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d44c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a8 expref: 1140 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226446:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:3.0:1782487586.226454:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.226515:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226528:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.226538:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.226665:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c1568de reply state 0000000020c14aa6 transno 8589956931 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.226687:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.226761:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1141:294567:x1869066294361600:12345-192.168.202.21@tcp:36:touch.500 Request processed in 391us (597us total) trans 8589956931 rc 0/0 00000100:00100000:3.0:1782487586.226770:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27079 00000100:00100000:3.0:1782487586.226776:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213644150644 time 7213647747823 state 0x2 ref 0 00000100:00100000:2.0:1782487586.228482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.228600:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294362112 00000100:00100000:1.0:1782487586.228621:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294362112 00000100:00100000:1.0:1782487586.228645:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213644150644 time 7213647747823 state 0x0 ref 1 00000100:00100000:1.0:1782487586.228654:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213647847823 time 7213647747823 state 0x1 ref 1 00000100:00100000:1.0:1782487586.228683:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213647847823 time 7213650072278 state 0x0 ref 1 00000100:00100000:2.0:1782487586.228742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.228756:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+739:294538:x1869066294362112:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.228790:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487586.228810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.228818:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d48b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780bd expref: 739 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.228835:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb541321100) 00010000:00010000:1.0:1782487586.228842:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.228893:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.228903:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.228911:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.228985:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294361984 00000100:00100000:3.0:1782487586.228990:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294361984 00000004:00010000:1.0:1782487586.228992:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b142fd93 reply state 0000000053a40aa3 transno 8589956932 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.229001:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.229012:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650172278 time 7213650072278 state 0x1 ref 2 00000100:00100000:3.0:1782487586.229033:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294362368 00000100:00100000:3.0:1782487586.229036:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294362368 00000100:00100000:3.0:1782487586.229055:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650172278 time 7213650072278 state 0x1 ref 3 00000100:00100000:1.0:1782487586.229058:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+741:294538:x1869066294362112:12345-192.168.202.21@tcp:36:touch.500 Request processed in 361us (581us total) trans 8589956932 rc 0/0 00000100:00100000:1.0:1782487586.229078:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27080 00000100:00100000:3.0:1782487586.229086:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650575096 time 7213650475096 state 0x1 ref 2 00000100:00100000:3.0:1782487586.229100:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+740:294542:x1869066294361984:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.229111:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.229134:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229143:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229151:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229158:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.229163:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229171:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.229174:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213650575096 time 7213650563388 state 0x0 ref 2 00010000:00010000:3.0:1782487586.229192:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb4c9e2f900) 00000100:00100000:1.0:1782487586.229192:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1141:294570:x1869066294362368:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.229198:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.229215:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229220:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.229222:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d499 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229230:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d4ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780d2 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229252:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d4a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780cb expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229321:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229331:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229338:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229349:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229356:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.229363:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229468:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229479:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229489:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229504:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229512:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.229520:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487586.229824:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187c:0x0], index 0: 0 00000004:00080000:3.0:1782487586.229928:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1856:0x0], index 1: 0 00010000:00010000:1.0:1782487586.229995:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d4d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230004:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230011:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230042:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d4df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230042:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230058:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d4df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230068:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230072:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d4df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230077:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230085:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.230088:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230095:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230102:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230115:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230121:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230124:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.230130:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.230135:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.230135:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230142:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230145:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d4b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230154:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.230161:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a87e73d7 reply state 00000000e5ee319f transno 8589956933 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230165:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.230171:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782487586.230173:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.230175:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230181:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d4c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.230189:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c732265f reply state 0000000089d0c938 transno 8589956934 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230195:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d4ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d2 expref: 1143 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.230196:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.230223:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d2 expref: 1142 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230236:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d4a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780cb expref: 743 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230238:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487586.230244:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.230249:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30c00, rc 0) 00010000:00010000:3.0:1782487586.230261:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d4df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780cb expref: 742 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230275:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:3.0:1782487586.230278:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1782487586.230279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.230281:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7c00, rc 0) 00000100:00100000:1.0:1782487586.230291:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1143:294570:x1869066294362368:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1100us (1480us total) trans 8589956933 rc 0/0 00000100:00100000:1.0:1782487586.230299:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27082 00000100:00100000:3.0:1782487586.230313:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+743:294542:x1869066294361984:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1216us (1708us total) trans 8589956934 rc 0/0 00000100:00100000:3.0:1782487586.230322:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27081 00000100:00100000:3.0:1782487586.230327:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213650575096 time 7213650563388 state 0x2 ref 0 00000100:00100000:3.0:1782487586.230348:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294362496 00000100:00100000:3.0:1782487586.230352:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294362496 00000100:00100000:3.0:1782487586.230370:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213650575096 time 7213650563388 state 0x0 ref 1 00000100:00100000:3.0:1782487586.230378:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213650663388 time 7213650563388 state 0x1 ref 1 00010000:00010000:3.0:1782487586.230404:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230412:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230419:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230426:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:1.0:1782487586.230427:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650663388 time 7213651815427 state 0x0 ref 1 00010000:00010000:3.0:1782487586.230433:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230440:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.230441:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1143:294567:x1869066294362496:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.230456:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.230458:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487586.230461:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.230463:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.230468:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85d4a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230468:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85d4ed lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780d9 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230505:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85d4ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d9 expref: 1144 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230515:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85d4ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d9 expref: 1144 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.230529:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.230531:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.230533:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30400, rc 0) 00000100:00100000:1.0:1782487586.230563:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1144:294567:x1869066294362496:12345-192.168.202.21@tcp:101:touch.500 Request processed in 125us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.230570:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27083 00000100:00100000:1.0:1782487586.230574:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650663388 time 7213651815427 state 0x2 ref 0 00000100:00100000:2.0:1782487586.231884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.231912:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294362624 00000100:00100000:3.0:1782487586.231917:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294362624 00000100:00100000:3.0:1782487586.231938:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213650663388 time 7213651815427 state 0x0 ref 1 00000100:00100000:3.0:1782487586.231946:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213651915427 time 7213651815427 state 0x1 ref 1 00000100:00100000:3.0:1782487586.231970:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213651915427 time 7213653360698 state 0x0 ref 1 00000100:00100000:3.0:1782487586.231982:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+742:294538:x1869066294362624:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.231997:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.232011:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d4f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780e0 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232044:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e0 expref: 743 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232054:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e0 expref: 743 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232066:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:3.0:1782487586.232070:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.232074:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5735d6200, rc 0) 00000100:00100000:3.0:1782487586.232152:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+743:294538:x1869066294362624:12345-192.168.202.21@tcp:101:touch.500 Request processed in 171us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.232160:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27084 00000100:00100000:3.0:1782487586.232165:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213651915427 time 7213653360698 state 0x2 ref 0 00010000:00010000:3.0:1782487586.232927:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232934:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232938:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232942:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.232945:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232950:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232959:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487586.232961:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.232963:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.232967:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d4bc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233436:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233445:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233451:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233457:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.233461:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233468:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233479:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c9e2fd00) 00010000:00010000:3.0:1782487586.233482:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.233486:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.233492:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d4ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.235512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.235542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.235567:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294362880 00000100:00100000:1.0:1782487586.235573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.235577:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294362880 00000100:00100000:2.0:1782487586.235600:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363392 00000100:00100000:1.0:1782487586.235621:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.235633:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363392 00000100:00100000:1.0:1782487586.235647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.235671:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363264 00000100:00100000:2.0:1782487586.235674:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363264 00000100:00100000:2.0:1782487586.235699:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16228 00000100:00100000:2.0:1782487586.235710:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2361:x1869066294363392:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.235727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.235762:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363136 00000100:00100000:1.0:1782487586.235766:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363136 00000100:00100000:1.0:1782487586.235789:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213651915427 time 7213653360698 state 0x0 ref 1 00000100:00100000:1.0:1782487586.235800:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213653460698 time 7213653360698 state 0x1 ref 1 00000100:00100000:1.0:1782487586.235871:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363648 00000100:00100000:1.0:1782487586.235875:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363648 00000100:00100000:1.0:1782487586.235889:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213653460698 time 7213653360698 state 0x1 ref 2 00000100:00100000:1.0:1782487586.235900:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363776 00000100:00100000:1.0:1782487586.235903:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363776 00000100:00100000:1.0:1782487586.235914:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213653460698 time 7213653360698 state 0x1 ref 3 00000100:00100000:1.0:1782487586.235931:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213657421410 time 7213657321410 state 0x1 ref 3 00000100:00100000:1.0:1782487586.235940:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+743:294545:x1869066294363136:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.235955:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.235970:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d4fb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780e7 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.235976:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2361:x1869066294363392:12345-192.168.202.21@tcp:2:touch.500 Request processed in 266us (401us total) trans 8589940014 rc 0/0 00000100:00100000:2.0:1782487586.235987:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16228 00000100:00100000:2.0:1782487586.236012:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16229 00000100:00100000:2.0:1782487586.236022:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+124:2361:x1869066294363264:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:1.0:1782487586.236091:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236105:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236116:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236130:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236138:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236144:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.236230:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+125:2361:x1869066294363264:12345-192.168.202.21@tcp:2:touch.500 Request processed in 209us (625us total) trans 8589940677 rc 0/0 00000100:00100000:2.0:1782487586.236239:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16229 00000100:00100000:2.0:1782487586.236280:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213657769937 time 7213657669937 state 0x1 ref 3 00000100:00100000:2.0:1782487586.236289:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1144:294570:x1869066294363648:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.236311:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.236326:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d4d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d2 expref: 1144 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236341:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.236350:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.236388:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236395:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236401:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.236477:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000663c74c0 reply state 0000000004148c52 transno 8589956935 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.236483:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.236527:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1145:294570:x1869066294363648:12345-192.168.202.21@tcp:36:touch.500 Request processed in 238us (879us total) trans 8589956935 rc 0/0 00000100:00100000:2.0:1782487586.236535:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27086 00000004:00080000:1.0:1782487586.236556:0:213684:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187d:0x0], index 0: 0 00000100:00100000:2.0:1782487586.236560:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213657769937 time 7213657949655 state 0x0 ref 2 00000100:00100000:2.0:1782487586.236574:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1144:294571:x1869066294363776:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.236582:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.236592:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d517 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780ee expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236651:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236660:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236669:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236682:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236690:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236698:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236765:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d52c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236774:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d52c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236780:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236783:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d52c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236795:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236805:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.236826:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb07:0x0]: returning size 0 00000004:00200000:2.0:1782487586.236831:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.236843:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236853:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236866:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236874:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.236891:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236892:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236909:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.236916:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237020:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.237020:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.237029:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237029:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237049:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237050:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237081:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.237086:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.237090:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.237091:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237095:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.237100:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237103:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85d51e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237111:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d502 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237122:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.237123:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000338db59f reply state 00000000ec220a50 transno 8589956936 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237140:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.237140:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.237150:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237156:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.237160:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237162:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d4fb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e7 expref: 746 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237178:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237185:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d52c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e7 expref: 745 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237192:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb541321c00) 00010000:00010000:1.0:1782487586.237194:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb5432e7500) 00010000:00010000:2.0:1782487586.237196:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.237210:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.237213:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.237215:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c600, rc 0) 00010000:00010000:2.0:1782487586.237225:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85d525 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.237244:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+746:294545:x1869066294363136:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1304us (1701us total) trans 8589956936 rc 0/0 00000100:00100000:1.0:1782487586.237253:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27085 00010000:00010000:2.0:1782487586.237256:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d517 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780ee expref: 1146 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237273:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780ee expref: 1145 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237282:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb541321500) 00010000:00010000:2.0:1782487586.237285:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.237289:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551446000, rc 0) 00000100:00100000:2.0:1782487586.237317:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1145:294571:x1869066294363776:12345-192.168.202.21@tcp:101:rm.500 Request processed in 745us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.237325:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27087 00000100:00100000:2.0:1782487586.237331:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213657769937 time 7213657949655 state 0x2 ref 0 00000100:00100000:2.0:1782487586.237495:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213657769937 time 7213657949655 state 0x0 ref 1 00000100:00100000:2.0:1782487586.237505:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213658049655 time 7213657949655 state 0x1 ref 1 00000100:00100000:2.0:1782487586.237568:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213658049655 time 7213658957820 state 0x0 ref 1 00000100:00100000:2.0:1782487586.237580:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+745:294542:x1869066294362880:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.237603:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.237635:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d4df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780cb expref: 745 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237649:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb4549e8600) 00010000:00010000:2.0:1782487586.237658:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.237698:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237708:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.237717:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.237792:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000588413aa reply state 000000005a56f5e5 transno 8589956937 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.237799:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.237844:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+746:294542:x1869066294362880:12345-192.168.202.21@tcp:36:touch.500 Request processed in 267us (2337us total) trans 8589956937 rc 0/0 00000100:00100000:2.0:1782487586.237850:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27088 00000100:00100000:2.0:1782487586.237854:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213658049655 time 7213658957820 state 0x2 ref 0 00010000:00010000:3.0:1782487586.238072:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238081:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238088:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238094:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.238098:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238105:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238116:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb541321b00) 00010000:00010000:3.0:1782487586.238119:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.238122:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.238126:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85d510 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238497:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238503:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238508:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238512:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.238515:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238521:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238533:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5432e7b00) 00010000:00010000:2.0:1782487586.238536:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.238539:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.238545:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d509 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.239315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.239344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.239347:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294363904 00000100:00100000:3.0:1782487586.239353:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294363904 00000100:00100000:3.0:1782487586.239373:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213658049655 time 7213658957820 state 0x0 ref 1 00000100:00100000:1.0:1782487586.239377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.239383:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213659057820 time 7213658957820 state 0x1 ref 1 00000100:00100000:1.0:1782487586.239399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.239401:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213659057820 time 7213660791659 state 0x0 ref 1 00000100:00100000:3.0:1782487586.239412:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1144:294570:x1869066294363904:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.239422:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.239435:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d548 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780f5 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239462:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d548 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780f5 expref: 1145 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239472:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d548 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780f5 expref: 1145 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239487:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239491:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239496:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239499:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.239502:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239506:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239513:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321f00) 00010000:00010000:3.0:1782487586.239515:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.239518:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239524:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85d541 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.239552:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:3.0:1782487586.239555:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.239559:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4715acc00, rc 0) 00000100:00100000:2.0:1782487586.239691:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294364160 00000100:00100000:2.0:1782487586.239696:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294364160 00000100:00100000:2.0:1782487586.239727:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294364416 00000100:00100000:2.0:1782487586.239731:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294364416 00000100:00100000:2.0:1782487586.239752:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5783 00000100:00100000:2.0:1782487586.239762:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1146:294567:x1869066294364160:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.239942:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1147:294567:x1869066294364160:12345-192.168.202.21@tcp:35:touch.500 Request processed in 182us (597us total) trans 8589956938 rc 0/0 00000100:00100000:2.0:1782487586.239948:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5783 00000100:00100000:2.0:1782487586.239962:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5784 00000100:00100000:2.0:1782487586.239967:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+744:294538:x1869066294364416:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.240094:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+745:294538:x1869066294364416:12345-192.168.202.21@tcp:35:touch.500 Request processed in 124us (717us total) trans 8589956939 rc 0/0 00000100:00100000:2.0:1782487586.240102:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5784 00000100:00100000:2.0:1782487586.240129:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294364544 00000100:00100000:2.0:1782487586.240133:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294364544 00000100:00100000:2.0:1782487586.240172:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16230 00000100:00100000:2.0:1782487586.240181:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2360:x1869066294364544:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.240189:0:213384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.240213:0:213384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4780fc expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.240231:0:213384:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1853:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.240242:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.240245:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.240252:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 102 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.240263:0:213384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 102 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.240274:0:213384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb48b446e00, rc 0) 00000100:00100000:2.0:1782487586.240292:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2360:x1869066294364544:12345-192.168.202.21@tcp:101:rm.500 Request processed in 113us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.240297:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16230 00000100:00100000:1.0:1782487586.240903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.240923:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294365056 00000100:00100000:1.0:1782487586.240927:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294365056 00000100:00100000:1.0:1782487586.240948:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213660891659 time 7213660791659 state 0x1 ref 2 00000100:00100000:1.0:1782487586.240969:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213660891659 time 7213662359673 state 0x0 ref 2 00000100:00100000:2.0:1782487586.240976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.240985:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+745:294545:x1869066294365056:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:2.0:1782487586.241000:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294364928 00000100:00100000:2.0:1782487586.241004:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294364928 00010000:00010000:1.0:1782487586.241010:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487586.241021:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213662459673 time 7213662359673 state 0x1 ref 3 00010000:00010000:1.0:1782487586.241026:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d52c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e7 expref: 746 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.241039:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213662459673 time 7213662430278 state 0x0 ref 3 00010000:00010000:1.0:1782487586.241042:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb5432e7500) 00000100:00100000:2.0:1782487586.241048:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+745:294549:x1869066294364928:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.241050:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.241056:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.241066:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d556 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478103 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.241096:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.241107:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.241116:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241171:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241180:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241186:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.241188:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002269eaff reply state 000000006eae5059 transno 8589956940 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241197:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.241198:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.241221:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241227:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.241258:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+748:294545:x1869066294365056:12345-192.168.202.21@tcp:36:touch.500 Request processed in 274us (355us total) trans 8589956940 rc 0/0 00000100:00100000:1.0:1782487586.241265:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27090 00000004:00080000:2.0:1782487586.241653:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1857:0x0], index 1: 0 00010000:00010000:2.0:1782487586.241799:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241808:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241817:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241845:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241852:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241858:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241864:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.241869:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241875:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241889:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.241893:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.241897:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241904:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d564 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.241915:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad6e3a5b reply state 000000008ae35cbb transno 8589956941 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.241922:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.241945:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d556 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478103 expref: 749 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241960:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478103 expref: 748 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.241968:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb541321a00) 00010000:00010000:2.0:1782487586.241971:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.241974:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7600, rc 0) 00000100:00100000:2.0:1782487586.242012:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+749:294549:x1869066294364928:12345-192.168.202.21@tcp:101:touch.500 Request processed in 963us (1037us total) trans 8589956941 rc 0/0 00000100:00100000:2.0:1782487586.242020:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27091 00000100:00100000:3.0:1782487586.242708:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1146:294570:x1869066294363904:12345-192.168.202.21@tcp:101:touch.500 Request processed in 3296us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.242716:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27089 00000100:00100000:3.0:1782487586.242722:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213662459673 time 7213662430278 state 0x2 ref 0 00000100:00100000:2.0:1782487586.242952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.242984:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.243013:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294365184 00000100:00100000:2.0:1782487586.243019:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294365184 00000100:00100000:1.0:1782487586.243019:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294365440 00000100:00100000:1.0:1782487586.243025:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294365440 00000100:00100000:2.0:1782487586.243043:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213662459673 time 7213662430278 state 0x0 ref 1 00000100:00100000:1.0:1782487586.243049:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213662530278 time 7213662430278 state 0x1 ref 2 00000100:00100000:1.0:1782487586.243164:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213662530278 time 7213664554879 state 0x0 ref 2 00000100:00100000:2.0:1782487586.243174:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213664654879 time 7213664554879 state 0x1 ref 2 00000100:00100000:1.0:1782487586.243175:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45ac59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1146:294575:x1869066294365440:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.243193:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.243215:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d580 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478111 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.243249:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213664654879 time 7213664638839 state 0x0 ref 2 00000100:00100000:2.0:1782487586.243264:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45ac5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+749:294542:x1869066294365184:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.243276:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.243290:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d587 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47810a expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.243324:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47810a expref: 750 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.243336:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d587 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47810a expref: 750 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.243353:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321c00) 00010000:00010000:2.0:1782487586.243356:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.243359:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad6a00, rc 0) 00000100:00100000:2.0:1782487586.243401:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45ac5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+750:294542:x1869066294365184:12345-192.168.202.21@tcp:101:touch.500 Request processed in 140us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.243409:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27093 00010000:00010000:1.0:1782487586.243481:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243493:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243502:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243516:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243523:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243530:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243587:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d59c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243596:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243602:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d59c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.243632:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb42:0x0]: returning size 0 00010000:00010000:1.0:1782487586.243701:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243709:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243715:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243720:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.243724:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243731:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243744:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.243747:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.243750:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243757:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d58e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243768:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243774:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243780:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243785:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.243788:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243794:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243800:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb5432e7c00) 00010000:00010000:1.0:1782487586.243814:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.243817:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243822:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d595 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243852:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d580 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478111 expref: 1149 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243863:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d59c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478111 expref: 1148 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.243870:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.243873:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.243875:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196d200, rc 0) 00000100:00100000:1.0:1782487586.243902:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45ac59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1148:294575:x1869066294365440:12345-192.168.202.21@tcp:101:touch.500 Request processed in 729us (918us total) trans 8589956942 rc 0/0 00000100:00100000:1.0:1782487586.243909:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27092 00000100:00100000:1.0:1782487586.243913:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213664654879 time 7213664638839 state 0x2 ref 0 00010000:00010000:3.0:1782487586.244286:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244295:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244302:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244306:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.244309:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244314:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244323:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb5432e7300) 00010000:00010000:3.0:1782487586.244325:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.244327:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244386:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d7000/0x66475b4e8b85d55d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244455:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.244456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.244467:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244471:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244475:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.244477:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244482:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.244489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.244490:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb541321e00) 00010000:00010000:3.0:1782487586.244493:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.244496:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.244500:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d56b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.244553:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294365568 00000100:00100000:2.0:1782487586.244559:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294365568 00000100:00100000:2.0:1782487586.244592:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16231 00000100:00100000:2.0:1782487586.244598:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+125:2361:x1869066294365568:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.244766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.244792:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294365824 00000100:00100000:1.0:1782487586.244796:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294365824 00000100:00100000:2.0:1782487586.244825:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+126:2361:x1869066294365568:12345-192.168.202.21@tcp:2:touch.500 Request processed in 226us (370us total) trans 8589940678 rc 0/0 00000100:00100000:2.0:1782487586.244832:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16231 00000100:00100000:1.0:1782487586.244867:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213664654879 time 7213664638839 state 0x0 ref 1 00000100:00100000:1.0:1782487586.244877:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213664738839 time 7213664638839 state 0x1 ref 1 00000100:00100000:1.0:1782487586.244890:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294366080 00000100:00100000:1.0:1782487586.244893:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294366080 00000100:00100000:1.0:1782487586.244904:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213664738839 time 7213664638839 state 0x1 ref 2 00000100:00100000:1.0:1782487586.244916:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213666407464 time 7213666307464 state 0x1 ref 2 00000100:00100000:2.0:1782487586.244927:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213666407464 time 7213666315106 state 0x0 ref 2 00000100:00100000:1.0:1782487586.244927:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+749:294549:x1869066294365824:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:2.0:1782487586.244947:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+749:294553:x1869066294366080:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.244957:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.244963:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.244968:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d5aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478118 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.244979:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d572 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478103 expref: 749 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.244992:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb541321a00) 00010000:00010000:1.0:1782487586.244998:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.245039:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.245049:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245052:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.245059:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245066:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245077:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245095:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245103:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245111:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.245126:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003afc3862 reply state 000000008b395423 transno 8589956943 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.245135:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.245178:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+751:294549:x1869066294365824:12345-192.168.202.21@tcp:36:touch.500 Request processed in 253us (689us total) trans 8589956943 rc 0/0 00000100:00100000:1.0:1782487586.245185:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27094 00000004:00080000:2.0:1782487586.245551:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187e:0x0], index 0: 0 00010000:00010000:2.0:1782487586.245708:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d5c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245723:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245732:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245759:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245766:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245774:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245780:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.245784:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245791:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245801:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.245805:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.245809:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245815:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d5b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.245828:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0ed660a reply state 000000005d570594 transno 8589956944 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.245835:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.245856:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d5aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478118 expref: 752 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245872:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478118 expref: 751 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.245878:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb541321600) 00010000:00010000:2.0:1782487586.245881:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.245883:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498400, rc 0) 00000100:00100000:2.0:1782487586.245914:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+752:294553:x1869066294366080:12345-192.168.202.21@tcp:101:touch.500 Request processed in 971us (1148us total) trans 8589956944 rc 0/0 00000100:00100000:2.0:1782487586.245923:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27095 00000100:00100000:2.0:1782487586.245930:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213666407464 time 7213666315106 state 0x2 ref 0 00000100:00100000:1.0:1782487586.246246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.246286:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294366336 00000100:00100000:3.0:1782487586.246292:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294366336 00000100:00100000:3.0:1782487586.246332:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16232 00000100:00100000:3.0:1782487586.246341:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2362:x1869066294366336:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.246525:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:838f7623-bf1c-484f-8afd-fb26a1863ad0+130:2362:x1869066294366336:12345-192.168.202.21@tcp:2:touch.500 Request processed in 184us (277us total) trans 8589940015 rc 0/0 00000100:00100000:3.0:1782487586.246533:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16232 00000100:00100000:2.0:1782487586.246882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.246933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.247007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.248132:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294366208 00000100:00100000:1.0:1782487586.248169:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294366592 00000100:00100000:1.0:1782487586.248175:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294366592 00000100:00100000:2.0:1782487586.248191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.248210:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294366848 00000100:00100000:1.0:1782487586.248214:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294366848 00000100:00100000:2.0:1782487586.248228:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294367104 00000100:00100000:2.0:1782487586.248234:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294367104 00000100:00100000:1.0:1782487586.248234:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213666407464 time 7213666315106 state 0x0 ref 1 00000100:00100000:1.0:1782487586.248246:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213666415106 time 7213666315106 state 0x1 ref 1 00000100:00100000:1.0:1782487586.248267:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213666415106 time 7213669657232 state 0x0 ref 1 00000100:00100000:2.0:1782487586.248273:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5785 00000100:00100000:1.0:1782487586.248278:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1150:294571:x1869066294366848:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:2.0:1782487586.248288:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1150:294570:x1869066294367104:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487586.248315:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.248333:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85d533 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780ee expref: 1150 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248353:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d29a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb07:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47801c expref: 1149 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248363:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb541321500) 00010000:00010000:1.0:1782487586.248371:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.248386:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248397:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248405:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248420:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248426:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248433:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248516:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248525:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.248533:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.248543:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1149:294570:x1869066294367104:12345-192.168.202.21@tcp:35:touch.500 Request processed in 258us (351us total) trans 8589956945 rc 0/0 00000100:00100000:2.0:1782487586.248552:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5785 00000100:00100000:3.0:1782487586.248816:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294366208 00000100:00100000:2.0:1782487586.248994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.249028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.249057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.249088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.249145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.249169:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294368000 00000100:00100000:2.0:1782487586.249174:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294368000 00000040:00080000:1.0:1782487586.249182:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2543, 64 off170944 00000100:00100000:2.0:1782487586.249219:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5786 00000100:00100000:2.0:1782487586.249229:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+753:294542:x1869066294368000:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.249350:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213669757232 time 7213669657232 state 0x1 ref 2 00000100:00100000:2.0:1782487586.249365:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294367232 00000100:00100000:2.0:1782487586.249369:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294367232 00000100:00100000:2.0:1782487586.249383:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213669757232 time 7213669657232 state 0x1 ref 3 00000100:00100000:2.0:1782487586.249394:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294367360 00000100:00100000:2.0:1782487586.249397:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294367360 00000100:00100000:2.0:1782487586.249410:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213669757232 time 7213669657232 state 0x1 ref 4 00000100:00100000:2.0:1782487586.249420:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294367616 00000100:00100000:2.0:1782487586.249423:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294367616 00000100:00100000:2.0:1782487586.249435:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213669757232 time 7213669657232 state 0x1 ref 5 00000100:00100000:2.0:1782487586.249444:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213670934615 time 7213670834615 state 0x1 ref 5 00000100:00100000:2.0:1782487586.249455:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:294545:x1869066294366208:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.249466:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.249481:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85d5e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47811f expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249522:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85d5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47811f expref: 758 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249535:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85d5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47811f expref: 758 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.249545:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294542:x1869066294368000:12345-192.168.202.21@tcp:35:touch.500 Request processed in 317us (400us total) trans 8589956947 rc 0/0 00010000:00010000:2.0:1782487586.249553:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb541321e00) 00000100:00100000:1.0:1782487586.249554:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5786 00010000:00010000:2.0:1782487586.249560:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.249564:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd88200, rc 0) 00000100:00100000:1.0:1782487586.249576:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294367744 00000100:00100000:1.0:1782487586.249580:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294367744 00000100:00100000:2.0:1782487586.249592:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294545:x1869066294366208:12345-192.168.202.21@tcp:101:touch.500 Request processed in 138us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.249595:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213670934615 time 7213670834615 state 0x1 ref 6 00000100:00100000:2.0:1782487586.249630:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27097 00000100:00100000:1.0:1782487586.249641:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213671130561 time 7213671030561 state 0x1 ref 6 00000100:00100000:1.0:1782487586.249651:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294549:x1869066294367232:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487586.249721:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213671210815 time 7213671110815 state 0x1 ref 5 00010000:00010000:1.0:1782487586.249721:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.249734:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d5f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478126 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.249735:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:294576:x1869066294367360:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.249749:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.249761:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d5f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47812d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249769:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478126 expref: 758 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249781:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478126 expref: 759 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249795:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:1.0:1782487586.249798:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.249799:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249812:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249821:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249835:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249843:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249851:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249853:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb451ad7600, rc 0) 00000100:00100000:1.0:1782487586.249878:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294549:x1869066294367232:12345-192.168.202.21@tcp:101:touch.500 Request processed in 228us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.249885:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27098 00000100:00100000:1.0:1782487586.249901:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213671391805 time 7213671291805 state 0x1 ref 4 00000100:00100000:1.0:1782487586.249912:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294553:x1869066294367616:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.249932:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249933:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.249945:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249948:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d5c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478118 expref: 758 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.249958:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.249963:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb541321600) 00010000:00010000:1.0:1782487586.249971:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1782487586.249981:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb48:0x0]: returning size 0 00000004:00200000:2.0:1782487586.249985:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.249998:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250007:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250010:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250019:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250021:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250031:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250035:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250054:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250060:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.250065:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250072:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250082:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.250084:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.250088:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250094:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d5fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.250100:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fcf02d6 reply state 00000000686b06e2 transno 8589956948 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250105:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250120:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.250122:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.250131:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250138:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.250142:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250153:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.250160:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294553:x1869066294367616:12345-192.168.202.21@tcp:36:touch.500 Request processed in 247us (1102us total) trans 8589956948 rc 0/0 00010000:00010000:2.0:1782487586.250168:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb541321a00) 00000100:00100000:1.0:1782487586.250169:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27100 00010000:00010000:2.0:1782487586.250175:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.250179:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.250185:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d605 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.250189:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213671391805 time 7213671578550 state 0x0 ref 3 00000100:00100000:1.0:1782487586.250213:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294572:x1869066294367744:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.250220:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.250229:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d61a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478134 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250253:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250259:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250262:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250274:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250278:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250282:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250290:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.250292:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250295:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250308:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250317:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250322:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:3.0:1782487586.250326:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.250326:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250330:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.250347:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196ce00/0x66475b4e8b85d5b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250392:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250400:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250406:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.250421:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb47:0x0]: returning size 0 00000004:00200000:1.0:1782487586.250424:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.250433:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250441:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250448:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250454:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250460:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250464:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.250467:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250473:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250482:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.250485:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.250488:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250493:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d621 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250503:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250509:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250515:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250520:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.250522:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250528:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250533:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.250536:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.250538:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250544:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d628 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250562:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d61a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478134 expref: 759 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250573:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478134 expref: 758 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250580:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb541321800) 00010000:00010000:1.0:1782487586.250582:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.250585:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57edffa00, rc 0) 00000100:00100000:1.0:1782487586.250602:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294572:x1869066294367744:12345-192.168.202.21@tcp:101:rm.500 Request processed in 404us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.250624:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27101 00010000:00010000:1.0:1782487586.250751:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250761:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250769:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250776:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250782:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250787:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250858:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.250871:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.250876:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250883:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.250886:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250893:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250901:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.250903:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.250906:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250912:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d636 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb07:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250922:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.250924:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.250925:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.250933:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250939:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250945:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250950:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.250954:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250959:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250966:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb07:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.250968:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.250971:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250977:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d5e2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb07:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250991:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.250997:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251003:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251008:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.251010:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251016:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251026:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.251028:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.251031:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251036:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d5d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.251045:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007222453b reply state 00000000b64299a8 transno 8589956946 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251051:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.251068:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.251078:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251080:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1150:294571:x1869066294366848:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2804us (4072us total) trans 8589956946 rc 0/0 00010000:00010000:3.0:1782487586.251093:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251094:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27096 00010000:00010000:3.0:1782487586.251104:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.251108:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.251116:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251124:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213671678550 time 7213671578550 state 0x1 ref 2 00010000:00010000:3.0:1782487586.251127:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb541321d00) 00010000:00010000:3.0:1782487586.251133:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.251137:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.251144:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d5bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251144:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213671678550 time 7213672534642 state 0x0 ref 2 00000100:00100000:1.0:1782487586.251162:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1149:294575:x1869066294366592:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.251180:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.251193:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a196d200/0x66475b4e8b85d59c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478111 expref: 1149 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.251246:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d5f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47812d expref: 757 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.251257:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47812d expref: 756 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.251262:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487586.251264:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.251266:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d200, rc 0) 00000100:00100000:2.0:1782487586.251286:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294576:x1869066294367360:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1555us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.251292:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27099 00010000:00010000:1.0:1782487586.251325:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.251330:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.251365:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251377:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251385:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251411:0:213935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.251424:0:213935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.251438:0:213935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45036bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220480:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487586.251489:0:213935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb550e90900 going to sleep for 11 seconds 00000100:00100000:1.0:1782487586.253396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.253429:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253441:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253449:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253455:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.253460:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253467:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253484:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb5432e7c00) 00010000:00010000:3.0:1782487586.253488:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.253492:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.253498:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d613 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.253534:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294368128 00010000:00010000:2.0:1782487586.253581:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253589:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253600:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253624:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.253628:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253635:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253646:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8244fa8 (ffff9cb5432e7500) 00010000:00010000:2.0:1782487586.253649:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.253652:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.253658:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d5db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc8244fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.253821:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294368128 00000100:00100000:3.0:1782487586.253870:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16233 00000100:00100000:3.0:1782487586.253881:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+152:2363:x1869066294368128:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.254138:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+153:2363:x1869066294368128:12345-192.168.202.21@tcp:2:touch.500 Request processed in 258us (744us total) trans 8589940679 rc 0/0 00000100:00100000:3.0:1782487586.254147:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16233 00000100:00100000:2.0:1782487586.254322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.254340:0:213935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45036bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220480:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487586.254362:0:213935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.254370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.254443:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294368256 00000100:00100000:3.0:1782487586.254447:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294368256 00000100:00100000:1.0:1782487586.254935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.254958:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16234 00000100:00100000:3.0:1782487586.254969:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+153:2362:x1869066294368256:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.254979:0:195192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.254979:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294368640 00000100:00100000:1.0:1782487586.254985:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294368640 00010000:00010000:3.0:1782487586.254998:0:195192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47813b expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.255009:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213672634642 time 7213672534642 state 0x1 ref 2 00002000:00010000:3.0:1782487586.255021:0:195192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187a:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00000100:00100000:1.0:1782487586.255029:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213672634642 time 7213676418311 state 0x0 ref 2 00010000:00010000:3.0:1782487586.255036:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=7213s v=(0 0) 00000100:00100000:1.0:1782487586.255042:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1148:294574:x1869066294368640:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.255044:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.255057:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 154 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255057:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.255074:0:195192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 154 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255082:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d64b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478142 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255086:0:195192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196ce00, rc 0) 00000100:00100000:3.0:1782487586.255120:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+154:2362:x1869066294368256:12345-192.168.202.21@tcp:101:rm.500 Request processed in 154us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.255129:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16234 00000100:00100000:3.0:1782487586.255157:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294368384 00000100:00100000:3.0:1782487586.255161:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294368384 00010000:00010000:3.0:1782487586.255181:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255186:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255199:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255219:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.255223:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6149 00000100:00100000:3.0:1782487586.255235:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+755:2362:x1869066294368384:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.255236:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255249:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255250:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.255261:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255261:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255287:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255307:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d365 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478054 expref: 755 pid: 190296 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255327:0:190282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:3.0:1782487586.255331:0:190282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255340:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255347:0:190282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.255368:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.255392:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:2362:x1869066294368384:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.255400:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6149 00000004:00080000:1.0:1782487586.255713:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1858:0x0], index 1: 0 00010000:00010000:1.0:1782487586.255852:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d660 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255861:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d660 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255868:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d660 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255898:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255905:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255911:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255916:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.255920:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255926:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255934:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.255936:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.255939:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255946:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d652 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.255956:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeee2541 reply state 00000000f63dd4a4 transno 8589956949 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.255964:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.255982:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d64b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478142 expref: 1151 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.255998:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d660 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478142 expref: 1150 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.256005:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.256008:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.256010:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c600, rc 0) 00000100:00100000:1.0:1782487586.256041:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1151:294574:x1869066294368640:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1003us (1107us total) trans 8589956949 rc 0/0 00000100:00100000:1.0:1782487586.256048:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27103 00010000:00010000:1.0:1782487586.256071:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.256078:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.256136:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a9acc59 reply state 0000000087e0e2c0 transno 8589956950 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.256142:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.256187:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1152:294575:x1869066294366592:12345-192.168.202.21@tcp:36:touch.500 Request processed in 5027us (9253us total) trans 8589956950 rc 0/0 00000100:00100000:1.0:1782487586.256194:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27102 00000100:00100000:1.0:1782487586.256199:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213672634642 time 7213676418311 state 0x2 ref 0 00000100:00100000:2.0:1782487586.256538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.256638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.256670:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369152 00000100:00100000:1.0:1782487586.256675:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369152 00000100:00100000:1.0:1782487586.256691:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213672634642 time 7213676418311 state 0x0 ref 1 00000100:00100000:1.0:1782487586.256700:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213676518311 time 7213676418311 state 0x1 ref 1 00000100:00100000:1.0:1782487586.256780:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213676518311 time 7213678169748 state 0x0 ref 1 00000100:00100000:1.0:1782487586.256792:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294543:x1869066294369152:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.256867:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.256883:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a481a00/0x66475b4e8b85d349 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478046 expref: 754 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.256900:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369024 00010000:00010000:1.0:1782487586.256902:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb54600/0x66475b4e8b85cf60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f27 expref: 753 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.256905:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369024 00010000:00010000:1.0:1782487586.256915:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.256928:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.256940:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.256941:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5787 00010000:00010000:1.0:1782487586.256953:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.256954:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57ed92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+753:294545:x1869066294369024:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487586.256967:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.256981:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.256988:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.256995:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.257153:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57ed92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294545:x1869066294369024:12345-192.168.202.21@tcp:35:touch.500 Request processed in 201us (616us total) trans 8589956951 rc 0/0 00000100:00100000:3.0:1782487586.257162:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5787 00010000:00010000:1.0:1782487586.257349:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.257358:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.257366:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.257394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.257505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.257827:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.257879:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369280 00000100:00100000:1.0:1782487586.257880:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369408 00000100:00100000:3.0:1782487586.257885:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369280 00000100:00100000:1.0:1782487586.257886:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369408 00000100:00100000:3.0:1782487586.257965:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16235 00000100:00100000:1.0:1782487586.257973:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16236 00000100:00100000:3.0:1782487586.257979:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2360:x1869066294369280:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487586.257987:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2361:x1869066294369408:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487586.257991:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.258008:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478149 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487586.258028:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1854:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.258040:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.258044:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.258052:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 132 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258066:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 132 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258076:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a196d200, rc 0) 00000100:00100000:3.0:1782487586.258107:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2360:x1869066294369280:12345-192.168.202.21@tcp:101:rm.500 Request processed in 134us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.258115:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16235 00000100:00100000:1.0:1782487586.258331:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2361:x1869066294369408:12345-192.168.202.21@tcp:2:touch.500 Request processed in 218us (697us total) trans 8589940016 rc 0/0 00000100:00100000:1.0:1782487586.258340:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16236 00000100:00100000:1.0:1782487586.258365:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369536 00000100:00100000:1.0:1782487586.258368:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369536 00000100:00100000:1.0:1782487586.258386:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213678269748 time 7213678169748 state 0x1 ref 2 00000100:00100000:3.0:1782487586.258453:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213678269748 time 7213679841456 state 0x0 ref 2 00000100:00100000:3.0:1782487586.258470:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294553:x1869066294369536:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.258482:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.258495:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d68a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478150 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258528:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d68a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478150 expref: 755 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258546:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d68a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478150 expref: 755 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.258557:0:190296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2549, 64 off171328 00010000:00010000:3.0:1782487586.258562:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487586.258566:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.258569:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d025bc00, rc 0) 00000100:00100000:3.0:1782487586.258595:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294553:x1869066294369536:12345-192.168.202.21@tcp:101:touch.500 Request processed in 127us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.258602:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27105 00010000:00010000:1.0:1782487586.258628:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258638:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258646:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258657:0:190296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258664:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258670:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258691:0:190296:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.258703:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258709:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258715:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258720:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45f92ca00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.258724:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258730:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258737:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.258738:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb54b3dc600) 00010000:00010000:1.0:1782487586.258743:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.258745:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258747:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258765:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.258770:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d67c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258772:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258787:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258791:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258798:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258799:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb40:0x0].0x0 (ffff9cb54b3dc600) 00010000:00010000:3.0:1782487586.258804:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.258808:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258814:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d691 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.258835:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.258837:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.258840:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.258862:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258868:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.258871:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258878:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258887:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.258889:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.258892:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.258898:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d66e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.258908:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044cbd36b reply state 00000000951a3a59 transno 8589956952 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.258915:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.258945:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294543:x1869066294369152:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2156us (2308us total) trans 8589956952 rc 0/0 00000100:00100000:1.0:1782487586.258953:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27104 00000100:00100000:1.0:1782487586.258957:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213678269748 time 7213679841456 state 0x2 ref 0 00000100:00100000:2.0:1782487586.259125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.259229:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259237:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259244:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259249:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.259252:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259258:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259267:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.259270:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.259273:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259279:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d659 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.259655:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294369792 00000100:00100000:1.0:1782487586.259659:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294369792 00000100:00100000:1.0:1782487586.259673:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213678269748 time 7213679841456 state 0x0 ref 1 00000100:00100000:1.0:1782487586.259681:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213679941456 time 7213679841456 state 0x1 ref 1 00000100:00100000:1.0:1782487586.259697:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213679941456 time 7213681088255 state 0x0 ref 1 00000100:00100000:1.0:1782487586.259706:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1151:294574:x1869066294369792:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.259734:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.259746:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45a49c600/0x66475b4e8b85d660 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478142 expref: 1151 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259757:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.259763:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.259800:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259973:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.259981:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.260046:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e2b1353 reply state 00000000d115519d transno 8589956953 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.260054:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.260101:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1152:294574:x1869066294369792:12345-192.168.202.21@tcp:36:touch.500 Request processed in 395us (977us total) trans 8589956953 rc 0/0 00000100:00100000:1.0:1782487586.260108:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27106 00000100:00100000:1.0:1782487586.260112:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213679941456 time 7213681088255 state 0x2 ref 0 00010000:00010000:2.0:1782487586.260246:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260259:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260267:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260273:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.260277:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260284:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260296:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:2.0:1782487586.260298:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.260300:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.260305:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d63d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.260713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.260745:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370048 00000100:00100000:1.0:1782487586.260750:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370048 00000100:00100000:2.0:1782487586.260754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.260768:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213679941456 time 7213681088255 state 0x0 ref 1 00000100:00100000:1.0:1782487586.260776:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213681188255 time 7213681088255 state 0x1 ref 1 00000100:00100000:1.0:1782487586.260791:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370176 00000100:00100000:1.0:1782487586.260794:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370176 00000100:00100000:3.0:1782487586.260806:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213681188255 time 7213682194521 state 0x0 ref 1 00000100:00100000:3.0:1782487586.260821:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1152:294577:x1869066294370048:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487586.260823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.260831:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.260848:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370304 00000100:00100000:3.0:1782487586.260852:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370304 00010000:00010000:1.0:1782487586.260861:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.260869:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.260875:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.260880:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.260883:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.260889:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16237 00010000:00010000:1.0:1782487586.260892:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.260901:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+154:2361:x1869066294370304:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:1.0:1782487586.260902:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb54b3dc800) 00010000:00010000:1.0:1782487586.260908:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.260911:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.260917:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d675 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.260956:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682294521 time 7213682194521 state 0x1 ref 2 00000100:00100000:1.0:1782487586.260977:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682294521 time 7213682368034 state 0x0 ref 2 00000100:00100000:1.0:1782487586.260987:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1152:294575:x1869066294370176:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.260994:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.261004:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d69f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47815e expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261033:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d69f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47815e expref: 1153 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261043:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571c00/0x66475b4e8b85d69f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47815e expref: 1153 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261057:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.261060:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.261063:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467571c00, rc 0) 00000100:00100000:1.0:1782487586.261165:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1153:294575:x1869066294370176:12345-192.168.202.21@tcp:101:touch.500 Request processed in 180us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.261172:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27108 00000100:00100000:3.0:1782487586.261178:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2361:x1869066294370304:12345-192.168.202.21@tcp:2:touch.500 Request processed in 277us (352us total) trans 8589940680 rc 0/0 00000100:00100000:3.0:1782487586.261187:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16237 00000100:00100000:2.0:1782487586.261192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.261226:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d6a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478157 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.261235:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370560 00000100:00100000:1.0:1782487586.261240:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370560 00000100:00100000:1.0:1782487586.261254:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682468034 time 7213682368034 state 0x1 ref 2 00010000:00010000:2.0:1782487586.261288:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.261296:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.261306:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.261310:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682468034 time 7213682699206 state 0x0 ref 2 00010000:00010000:2.0:1782487586.261318:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.261324:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.261332:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+755:294548:x1869066294370560:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.261334:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.261348:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb54b3dc300) 00010000:00010000:2.0:1782487586.261351:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.261355:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.261356:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.261365:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d698 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261373:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d3ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478085 expref: 755 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261392:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d008 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f58 expref: 754 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261400:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:3.0:1782487586.261406:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261407:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.261419:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261421:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261436:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261436:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261457:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261465:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261469:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261483:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261493:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261494:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261510:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261531:0:213935:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.261541:0:213935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261597:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261627:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.261637:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.261647:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb41:0x0]: returning size 0 00010000:00010000:2.0:1782487586.261996:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262006:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262013:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262019:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.262024:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262035:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262046:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.262049:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.262053:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262058:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d6ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262070:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.262079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.262082:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262090:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262106:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb455050600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.262109:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262116:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262125:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.262127:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.262131:0:196437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262138:0:196437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262144:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262167:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262173:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d6bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.262179:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.262188:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262216:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d6a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1154 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262230:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1153 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.262237:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:2.0:1782487586.262239:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.262243:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d600, rc 0) 00000100:00100000:1.0:1782487586.262252:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370816 00000100:00100000:1.0:1782487586.262257:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370816 00000100:00100000:2.0:1782487586.262287:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1153:294577:x1869066294370048:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1460us (1567us total) trans 8589956954 rc 0/0 00000100:00100000:1.0:1782487586.262294:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5788 00000100:00100000:2.0:1782487586.262301:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27107 00000100:00100000:1.0:1782487586.262308:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294553:x1869066294370816:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487586.262335:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.262348:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1152 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.262356:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.262388:0:213935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1152 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.262389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.262408:0:213935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1152 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.262412:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294370944 00000100:00100000:2.0:1782487586.262417:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294370944 00000100:00100000:3.0:1782487586.262427:0:213935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb579758380 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220608:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487586.262458:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16238 00000100:00100000:2.0:1782487586.262467:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+126:2363:x1869066294370944:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.262479:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+755:294553:x1869066294370816:12345-192.168.202.21@tcp:35:touch.500 Request processed in 175us (404us total) trans 8589956955 rc 0/0 00000100:00100000:1.0:1782487586.262488:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5788 00000100:00100000:3.0:1782487586.262493:0:213935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab90c0 going to sleep for 11 seconds 00002000:00010000:2.0:1782487586.262602:0:213223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1877:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782487586.262622:0:213223:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1877:0x0] updating lvb mtime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.262624:0:213223:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x1877:0x0] updating lvb atime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.262626:0:213223:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1877:0x0] updating lvb ctime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.262628:0:213223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1877:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782487586.262648:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+127:2363:x1869066294370944:12345-192.168.202.21@tcp:2:touch.500 Request processed in 183us (263us total) trans 8589940681 rc 0/0 00000100:00100000:2.0:1782487586.262653:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16238 00000100:00100000:1.0:1782487586.262903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.262992:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294371200 00000100:00100000:3.0:1782487586.262998:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294371200 00000100:00100000:1.0:1782487586.263016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.263037:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294371328 00000100:00100000:1.0:1782487586.263040:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294371328 00000100:00100000:3.0:1782487586.263042:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5789 00000100:00100000:3.0:1782487586.263054:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+755:294549:x1869066294371200:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.263060:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682799206 time 7213682699206 state 0x1 ref 2 00000100:00100000:1.0:1782487586.263082:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213682799206 time 7213684472856 state 0x0 ref 2 00000100:00100000:1.0:1782487586.263094:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1153:294574:x1869066294371328:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.263103:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.263116:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85d6de lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478165 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.263145:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85d6de lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478165 expref: 1154 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.263161:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85d6de lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478165 expref: 1154 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.263175:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:1.0:1782487586.263178:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.263180:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb56da25200, rc 0) 00000100:00100000:1.0:1782487586.263216:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1154:294574:x1869066294371328:12345-192.168.202.21@tcp:101:touch.500 Request processed in 125us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.263222:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27110 00000100:00100000:3.0:1782487586.263238:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294549:x1869066294371200:12345-192.168.202.21@tcp:35:touch.500 Request processed in 186us (334us total) trans 8589956956 rc 0/0 00000100:00100000:3.0:1782487586.263247:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5789 00000100:00100000:1.0:1782487586.264497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.264522:0:213935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb579758380 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220608:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487586.264530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.264547:0:213935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.264550:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294371584 00000100:00100000:2.0:1782487586.264556:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294371584 00000100:00100000:1.0:1782487586.264565:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294371712 00000100:00100000:1.0:1782487586.264574:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294371712 00000100:00100000:2.0:1782487586.264579:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213684572856 time 7213684472856 state 0x1 ref 2 00000100:00100000:1.0:1782487586.264592:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213684572856 time 7213684472856 state 0x1 ref 3 00000100:00100000:2.0:1782487586.264641:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213686097153 time 7213685997153 state 0x1 ref 3 00000100:00100000:3.0:1782487586.264652:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213686097153 time 7213686041639 state 0x0 ref 3 00000100:00100000:2.0:1782487586.264657:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1155:294577:x1869066294371584:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487586.264683:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1155:294580:x1869066294371712:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.264694:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.264706:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d6e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47816c expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.264725:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.264737:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.264745:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264758:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.264759:0:190298:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264779:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.264780:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264793:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264806:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264811:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264816:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264884:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264890:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264895:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.264911:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb09:0x0]: returning size 0 00000004:00200000:3.0:1782487586.264914:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487586.264923:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264933:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264938:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264943:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264947:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264951:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.264953:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264958:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264965:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.264967:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.264970:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264975:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d6f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264983:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264987:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264991:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.264995:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.264998:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265002:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265028:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487586.265031:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.265035:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265041:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d6fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265158:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d6e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47816c expref: 1157 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265168:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47816c expref: 1156 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265173:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:3.0:1782487586.265175:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.265177:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45653da00, rc 0) 00000100:00100000:3.0:1782487586.265218:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1156:294580:x1869066294371712:12345-192.168.202.21@tcp:101:rm.500 Request processed in 554us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.265229:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27112 00000100:00100000:2.0:1782487586.265252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.265281:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372096 00000100:00100000:3.0:1782487586.265286:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372096 00000100:00100000:3.0:1782487586.265328:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5790 00000100:00100000:3.0:1782487586.265339:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1156:294575:x1869066294372096:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.265373:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.265409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.265432:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372224 00000100:00100000:2.0:1782487586.265436:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372224 00000100:00100000:3.0:1782487586.265446:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1157:294575:x1869066294372096:12345-192.168.202.21@tcp:35:touch.500 Request processed in 109us (195us total) trans 8589956957 rc 0/0 00000100:00100000:3.0:1782487586.265452:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5790 00000100:00100000:3.0:1782487586.265476:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294371840 00000100:00100000:3.0:1782487586.265480:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294371840 00000100:00100000:2.0:1782487586.265490:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16239 00010000:00010000:3.0:1782487586.265496:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1157 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.265505:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2360:x1869066294372224:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.265522:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6150 00000100:00100000:3.0:1782487586.265530:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1157:2360:x1869066294371840:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487586.265539:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.265543:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1157 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265552:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1157 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265568:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d6c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478157 expref: 1157 pid: 196437 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265581:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487586.265586:0:192469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265595:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265601:0:192469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265632:0:192469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265653:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.265679:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1156:2360:x1869066294371840:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.265688:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6150 00000100:00100000:2.0:1782487586.265716:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2360:x1869066294372224:12345-192.168.202.21@tcp:2:touch.500 Request processed in 216us (306us total) trans 8589940017 rc 0/0 00000100:00100000:2.0:1782487586.265725:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16239 00010000:00010000:3.0:1782487586.265730:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.265739:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.266345:0:213935:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000bd1:0xb41:0x0] is inserted into orphan list, open count = 1 00000100:00100000:1.0:1782487586.266393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.266429:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.266431:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372352 00000100:00100000:2.0:1782487586.266437:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372352 00010000:00010000:3.0:1782487586.266438:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266445:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266451:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.266454:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266458:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.266461:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213686141639 time 7213686041639 state 0x1 ref 3 00010000:00010000:3.0:1782487586.266468:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487586.266472:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.266474:0:213935:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266479:0:213935:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266483:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.266488:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213686141639 time 7213687877478 state 0x0 ref 3 00010000:00010000:3.0:1782487586.266501:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.266502:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1156:294578:x1869066294372352:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.266515:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d6d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266519:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.266525:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266532:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266533:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d708 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478173 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266539:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266551:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.266553:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266558:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266567:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.266570:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.266573:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266575:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.266583:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d6b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266588:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.266598:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bff3d9da reply state 00000000da88a6ae transno 8589956958 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266603:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.266631:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.266644:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266654:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266670:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.266674:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:294548:x1869066294370560:12345-192.168.202.21@tcp:36:rm.500 Request processed in 5343us (5480us total) trans 8589956958 rc 0/0 00000100:00100000:3.0:1782487586.266685:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27109 00010000:00010000:2.0:1782487586.266746:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266756:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266764:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.266782:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb08:0x0]: returning size 0 00000004:00200000:2.0:1782487586.266786:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.266797:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266806:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266813:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266824:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266831:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266836:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.266840:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266847:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266857:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.266861:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.266864:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266870:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85d70f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266883:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266889:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266895:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266901:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.266905:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266912:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266921:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb541321a00) 00010000:00010000:2.0:1782487586.266924:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.266927:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266933:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85d716 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266959:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85d708 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478173 expref: 1158 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266974:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478173 expref: 1157 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.266981:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:2.0:1782487586.266984:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.266987:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc 0) 00000100:00100000:2.0:1782487586.267021:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1157:294578:x1869066294372352:12345-192.168.202.21@tcp:101:rm.500 Request processed in 522us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.267029:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27113 00010000:00010000:2.0:1782487586.267058:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.267066:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.267142:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074e44d78 reply state 00000000f4e0150a transno 8589956959 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.267149:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.267198:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1158:294577:x1869066294371584:12345-192.168.202.21@tcp:36:touch.500 Request processed in 2546us (2703us total) trans 8589956959 rc 0/0 00000100:00100000:2.0:1782487586.267218:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27111 00000100:00100000:2.0:1782487586.267223:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213686141639 time 7213687877478 state 0x2 ref 0 00000100:00100000:3.0:1782487586.269417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.269458:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372608 00000100:00100000:2.0:1782487586.269464:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372608 00000100:00100000:2.0:1782487586.269505:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5791 00000100:00100000:2.0:1782487586.269513:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1158:294574:x1869066294372608:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.269634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.269730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.269756:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294574:x1869066294372608:12345-192.168.202.21@tcp:35:touch.500 Request processed in 242us (341us total) trans 8589956960 rc 0/0 00000100:00100000:2.0:1782487586.269768:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5791 00000100:00100000:3.0:1782487586.269772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.269802:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294373120 00000100:00100000:2.0:1782487586.269806:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294373120 00000100:00100000:2.0:1782487586.269838:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1154 00000100:00100000:2.0:1782487586.269845:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:2362:x1869066294373120:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487586.269868:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.269881:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d724 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478181 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269914:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269929:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269939:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269952:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269960:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.269968:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270049:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270059:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270067:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.270080:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4a:0x0]: returning size 0 00000004:00200000:2.0:1782487586.270084:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.270096:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270105:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270118:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270124:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270130:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270137:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270141:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270149:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270159:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.270163:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.270168:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270174:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85d72b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270187:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270194:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270211:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270218:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270222:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270229:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270238:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb541321f00) 00000100:00100000:3.0:1782487586.270239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.270244:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.270248:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270255:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85d732 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270281:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85d724 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478181 expref: 759 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270294:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478181 expref: 758 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270302:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321c00) 00010000:00010000:2.0:1782487586.270305:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.270308:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb000, rc 0) 00010000:00010000:2.0:1782487586.270313:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.270322:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d740 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478188 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270361:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270370:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270378:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270391:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270398:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270406:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270469:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270477:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270484:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.270496:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb49:0x0]: returning size 0 00000004:00200000:2.0:1782487586.270499:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.270508:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270521:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270528:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270534:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270541:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270546:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270550:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270557:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.270567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.270568:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.270573:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.270576:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270582:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85d747 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270593:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270599:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270622:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270629:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270633:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270641:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270652:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb541321b00) 00010000:00010000:2.0:1782487586.270654:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.270658:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270664:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85d74e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270688:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85d740 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478188 expref: 760 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270702:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478188 expref: 759 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270710:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487586.270712:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.270715:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc6a00, rc 0) 00010000:00010000:2.0:1782487586.270720:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.270728:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d75c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47818f expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270749:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270758:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270766:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270777:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270784:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270792:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270851:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270860:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270867:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.270880:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4b:0x0]: returning size 0 00000004:00200000:2.0:1782487586.270883:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.270892:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270904:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270912:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270918:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270924:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270930:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270934:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270941:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270950:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.270953:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.270957:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270963:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85d763 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270974:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270980:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270987:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.270993:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.270997:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271003:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271012:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb541321100) 00010000:00010000:2.0:1782487586.271015:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.271018:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271024:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85d76a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271047:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85d75c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47818f expref: 761 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271061:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47818f expref: 760 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271068:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb541321e00) 00010000:00010000:2.0:1782487586.271071:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.271073:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7600, rc 0) 00010000:00010000:2.0:1782487586.271078:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.271086:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d778 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478196 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271106:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271115:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271123:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271134:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271141:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271149:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271220:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271229:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271237:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.271251:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4d:0x0]: returning size 0 00000004:00200000:2.0:1782487586.271254:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.271264:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271272:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271277:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271288:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271291:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271301:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271304:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271312:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.271317:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271317:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271334:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.271341:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271341:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271358:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271362:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4664e1600) 00010000:00010000:1.0:1782487586.271367:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.271370:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271372:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.271380:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.271382:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85d6c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271385:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271394:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d77f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271407:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271411:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372736 00010000:00010000:2.0:1782487586.271414:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271416:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372736 00010000:00010000:2.0:1782487586.271424:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271429:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.271433:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271439:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271448:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb541321700) 00010000:00010000:2.0:1782487586.271451:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782487586.271451:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294373376 00000100:00100000:1.0:1782487586.271455:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294373376 00010000:00010000:2.0:1782487586.271456:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271464:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d786 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271483:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16240 00000100:00100000:3.0:1782487586.271494:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16241 00010000:00010000:2.0:1782487586.271495:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d778 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478196 expref: 761 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271495:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2361:x1869066294372736:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.271509:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.271512:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2362:x1869066294373376:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.271518:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478196 expref: 760 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271523:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47817a expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.271525:0:213225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.271529:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487586.271537:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.271540:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54834c800, rc 0) 00010000:00010000:3.0:1782487586.271543:0:213225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781ab expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271546:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1782487586.271549:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187c:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.271558:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d7a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47819d expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271568:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=7213s v=(0 0) 00002000:00010000:3.0:1782487586.271569:0:213225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187b:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.271577:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.271582:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.271586:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.271587:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 130 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.271596:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.271601:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271634:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 130 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271638:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271651:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a49c600, rc 0) 00010000:00010000:3.0:1782487586.271655:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 130 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271658:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271667:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.271680:0:213225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 130 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271680:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271687:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+130:2361:x1869066294372736:12345-192.168.202.21@tcp:101:rm.500 Request processed in 193us (1955us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.271705:0:213225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5735d7000, rc 0) 00000100:00100000:1.0:1782487586.271705:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16240 00000100:00100000:3.0:1782487586.271735:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2362:x1869066294373376:12345-192.168.202.21@tcp:101:rm.500 Request processed in 227us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.271744:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16241 00010000:00010000:2.0:1782487586.271762:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271772:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271780:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.271792:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4c:0x0]: returning size 0 00000004:00200000:2.0:1782487586.271795:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.271805:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271807:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294372992 00000100:00100000:1.0:1782487586.271812:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294372992 00010000:00010000:2.0:1782487586.271822:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271830:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213686141639 time 7213687877478 state 0x0 ref 1 00010000:00010000:2.0:1782487586.271831:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271845:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271848:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213687977478 time 7213687877478 state 0x1 ref 1 00010000:00010000:2.0:1782487586.271858:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271864:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.271868:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271870:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294373248 00000100:00100000:1.0:1782487586.271875:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294373248 00010000:00010000:2.0:1782487586.271878:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271887:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213687977478 time 7213687877478 state 0x1 ref 2 00010000:00010000:2.0:1782487586.271889:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.271895:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.271899:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.271901:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213693389732 time 7213693289732 state 0x1 ref 2 00010000:00010000:2.0:1782487586.271914:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d7a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271915:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213693389732 time 7213693304858 state 0x0 ref 2 00000100:00100000:3.0:1782487586.271920:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+762:294556:x1869066294372992:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.271938:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.271938:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294577:x1869066294373248:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.271951:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.271951:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271952:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.271961:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.271964:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d7be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781a4 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.271969:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d39d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478062 expref: 762 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271969:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.271977:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.271998:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.272007:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d7be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781a4 expref: 1160 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272011:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb541321200) 00010000:00010000:3.0:1782487586.272012:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d0ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f90 expref: 761 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272018:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.272024:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.272031:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45f92ca00/0x66475b4e8b85d7be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0xb41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781a4 expref: 1160 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272038:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb56d889800) 00010000:00010000:2.0:1782487586.272039:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586e00/0x66475b4e8b85d7b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272054:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.272067:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487586.272070:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.272071:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.272075:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45f92ca00, rc 0) 00010000:00010000:2.0:1782487586.272080:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d7a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47819d expref: 761 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272088:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272098:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47819d expref: 760 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272099:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.272105:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294577:x1869066294373248:12345-192.168.202.21@tcp:101:touch.500 Request processed in 168us (1865us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.272121:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00000100:00100000:1.0:1782487586.272122:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27115 00010000:00010000:2.0:1782487586.272127:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.272130:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272131:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587e00, rc 0) 00010000:00010000:3.0:1782487586.272143:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272152:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.272177:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+760:2362:x1869066294373120:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2331us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.272190:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1154 00010000:00010000:2.0:1782487586.272237:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272244:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272251:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272257:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.272260:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272267:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272278:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:2.0:1782487586.272281:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.272284:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.272290:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85d6ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272371:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272378:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.272384:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.272916:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2550, 64 off171392 00010000:00010000:2.0:1782487586.272991:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273000:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273013:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273021:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273027:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273033:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273053:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.273066:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273073:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273078:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.273079:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273088:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273088:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.273094:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273099:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.273104:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273105:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273125:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273125:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.273132:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.273138:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273144:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb44:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.273146:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d7d3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273150:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.273156:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273166:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d7da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273166:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273185:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273192:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273198:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.273212:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.273214:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.273217:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.273222:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.273224:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273234:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.273238:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.273241:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.273247:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d600/0x66475b4e8b85d7c5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.273259:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e06f4530 reply state 0000000031e24a11 transno 8589956961 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.273270:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.273412:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+761:294556:x1869066294372992:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1494us (3644us total) trans 8589956961 rc 0/0 00000100:00100000:2.0:1782487586.273420:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27114 00000100:00100000:2.0:1782487586.273427:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213693389732 time 7213693304858 state 0x2 ref 0 00000100:00100000:1.0:1782487586.274301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.274410:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294373504 00000100:00100000:2.0:1782487586.274416:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294373504 00000100:00100000:2.0:1782487586.274455:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16242 00000100:00100000:2.0:1782487586.274464:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2363:x1869066294373504:12345-192.168.202.21@tcp:2:touch.500 00002000:00010000:2.0:1782487586.274636:0:213220:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1850:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782487586.274640:0:213220:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1850:0x0] updating lvb mtime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.274643:0:213220:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1850:0x0] updating lvb atime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.274646:0:213220:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1850:0x0] updating lvb ctime from disk: 1782487586 -> 1782487586 00002000:00010000:2.0:1782487586.274648:0:213220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1850:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782487586.274687:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2363:x1869066294373504:12345-192.168.202.21@tcp:2:touch.500 Request processed in 224us (387us total) trans 8589940018 rc 0/0 00000100:00100000:2.0:1782487586.274695:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16242 00010000:00010000:2.0:1782487586.274802:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274811:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274817:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274827:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.274832:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274839:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274850:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.274853:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.274857:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.274863:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d7cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.275265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.275302:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294373760 00000100:00100000:3.0:1782487586.275308:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294373760 00000100:00100000:3.0:1782487586.275328:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213693389732 time 7213693304858 state 0x0 ref 1 00000100:00100000:3.0:1782487586.275338:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213693404858 time 7213693304858 state 0x1 ref 1 00000100:00100000:3.0:1782487586.275364:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213693404858 time 7213696754482 state 0x0 ref 1 00000100:00100000:3.0:1782487586.275376:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294580:x1869066294373760:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:3.0:1782487586.275405:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782487586.275422:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85d701 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47816c expref: 1159 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275441:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85d548 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb09:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780f5 expref: 1158 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275452:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:3.0:1782487586.275461:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.275473:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275484:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275494:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275507:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275514:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275522:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275598:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275626:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.275636:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.276030:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2551, 64 off171456 00010000:00010000:3.0:1782487586.276100:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276110:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276118:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276126:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276134:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276140:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276158:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.276170:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276176:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276178:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.276186:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276187:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276213:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.276221:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276223:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.276230:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276233:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276240:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276247:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.276252:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.276255:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276260:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb09:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.276266:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.276272:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276273:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d7f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb09:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276289:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85d7ef lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb09:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.276295:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.276299:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.276303:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.276310:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276318:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276324:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276330:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.276334:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276341:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276355:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.276358:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.276361:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.276368:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85d7e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.276378:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063f770f4 reply state 00000000369bf20d transno 8589956962 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.276386:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.276430:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294580:x1869066294373760:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1055us (1164us total) trans 8589956962 rc 0/0 00000100:00100000:3.0:1782487586.276438:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27116 00000100:00100000:3.0:1782487586.276444:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213693404858 time 7213696754482 state 0x2 ref 0 00000100:00100000:1.0:1782487586.276817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.276845:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374016 00000100:00100000:1.0:1782487586.276850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.276851:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374016 00000100:00100000:3.0:1782487586.276885:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5792 00000100:00100000:3.0:1782487586.276893:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294577:x1869066294374016:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.276919:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.277017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.277037:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374144 00000100:00100000:2.0:1782487586.277041:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374144 00000100:00100000:2.0:1782487586.277079:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374272 00000004:00080000:3.0:1782487586.277083:0:199549:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0xb41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1782487586.277083:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374272 00000100:00100000:2.0:1782487586.277115:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16243 00000100:00100000:2.0:1782487586.277126:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2362:x1869066294374144:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:2.0:1782487586.277135:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.277150:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781b2 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.277157:0:199549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2544, 64 off171008 00002000:00010000:2.0:1782487586.277169:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1856:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.277184:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.277188:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.277196:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 134 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.277223:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 134 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.277234:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f586e00, rc 0) 00000100:00100000:2.0:1782487586.277263:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066294374144:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 140us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.277271:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16243 00000100:00100000:2.0:1782487586.277289:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16244 00000100:00100000:2.0:1782487586.277327:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2362:x1869066294374272:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:2.0:1782487586.277386:0:213222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.277397:0:213222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781b9 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.277411:0:213222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1855:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.277421:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.277425:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.277431:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 134 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.277443:0:213222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 134 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.277453:0:213222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587200, rc 0) 00000100:00100000:2.0:1782487586.277474:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066294374272:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 178us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.277480:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16244 00000100:00100000:1.0:1782487586.277543:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374400 00000100:00100000:1.0:1782487586.277547:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374400 00000100:00100000:1.0:1782487586.277579:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16245 00000100:00100000:1.0:1782487586.277587:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2362:x1869066294374400:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487586.277595:0:190930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.277641:0:190930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781c0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.277659:0:190930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187d:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.277669:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.277673:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.277680:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 156 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.277697:0:190930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 156 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.277706:0:190930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cdb54600, rc 0) 00000100:00100000:1.0:1782487586.277728:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+156:2362:x1869066294374400:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 142us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.277735:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16245 00010000:00010000:3.0:1782487586.277927:0:199549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.277940:0:199549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.277953:0:199549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.277961:0:199549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.277966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.277973:0:199549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.277980:0:199549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.277991:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374528 00000100:00100000:1.0:1782487586.277997:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374528 00010000:00010000:3.0:1782487586.278004:0:199549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487586.278029:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16246 00000100:00100000:1.0:1782487586.278039:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+156:2362:x1869066294374528:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487586.278047:0:213693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.278060:0:213693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781c7 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.278062:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294577:x1869066294374016:12345-192.168.202.21@tcp:35:touch.500 Request processed in 1167us (1244us total) trans 8589956963 rc 0/0 00000100:00100000:3.0:1782487586.278079:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5792 00002000:00010000:1.0:1782487586.278083:0:213693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187e:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.278093:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.278097:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.278104:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 157 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278115:0:213693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 157 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278130:0:213693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45a481a00, rc 0) 00010000:00010000:3.0:1782487586.278132:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.278138:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278147:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.278154:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.278154:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+157:2362:x1869066294374528:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 114us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.278169:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16246 00010000:00010000:3.0:1782487586.278171:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278186:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb41:0x0].0x0 (ffff9cb4664e1a00) 00010000:00010000:3.0:1782487586.278190:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.278194:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278214:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85d812 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 199549 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278228:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.278233:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487586.278234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.278238:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487586.278348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.278372:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374784 00000100:00100000:1.0:1782487586.278376:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374784 00000100:00100000:1.0:1782487586.278393:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213693404858 time 7213696754482 state 0x0 ref 1 00000100:00100000:1.0:1782487586.278404:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213696854482 time 7213696754482 state 0x1 ref 1 00000100:00100000:1.0:1782487586.278424:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213696854482 time 7213699814021 state 0x0 ref 1 00000100:00100000:1.0:1782487586.278434:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+760:294563:x1869066294374784:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.278461:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.278477:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d41b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47807e expref: 760 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278498:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85d1d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fc8 expref: 759 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278509:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:1.0:1782487586.278513:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.278526:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278536:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278543:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278557:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278564:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278572:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278678:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278689:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1159 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278697:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278720:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278729:0:190298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1159 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278731:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278747:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.278753:0:190298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1159 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278756:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467571000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.278763:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278781:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.278789:0:190298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299220736:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487586.278796:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xee224fa8 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487586.278800:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.278803:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.278810:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467571000/0x66475b4e8b85d7e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xee224fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.278846:0:190298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450ece600 going to sleep for 11 seconds 00000100:00100000:1.0:1782487586.278891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.278943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.278968:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375168 00000100:00100000:3.0:1782487586.278973:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375040 00000100:00100000:1.0:1782487586.278973:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375168 00000100:00100000:3.0:1782487586.278980:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375040 00000100:00100000:1.0:1782487586.278995:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213699914021 time 7213699814021 state 0x1 ref 2 00000100:00100000:1.0:1782487586.279019:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213699914021 time 7213700409288 state 0x0 ref 2 00000100:00100000:3.0:1782487586.279023:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1155 00000100:00100000:1.0:1782487586.279035:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294589:x1869066294375168:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:3.0:1782487586.279040:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:2360:x1869066294375040:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487586.279047:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.279059:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d835 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781f8 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279063:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.279076:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d83c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781ce expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279098:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279109:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279110:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279127:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279130:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279145:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279148:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279159:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279163:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279182:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279183:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279213:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279272:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279284:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279290:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279292:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279307:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.279309:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279312:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279324:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279326:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279345:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.279348:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.279352:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.279354:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb42:0x0]: returning size 0 00000004:00200000:1.0:1782487586.279362:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.279363:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d84a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279378:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.279379:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279393:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279397:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279402:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279408:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279411:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.279417:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279420:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279429:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279432:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279444:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.279445:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c5187400) 00010000:00010000:1.0:1782487586.279449:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279450:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.279456:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279461:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279466:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d858 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279477:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.279481:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.279485:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279491:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85d843 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279498:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d83c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ce expref: 760 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279506:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279511:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.279513:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279516:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.279524:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85d83c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ce expref: 760 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279526:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279542:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.279546:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.279550:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb45653dc00, rc -2) 00010000:00010000:1.0:1782487586.279553:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279563:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487586.279566:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.279569:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279576:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d851 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.279590:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:2360:x1869066294375040:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 555us (698us total) trans 0 rc -2/-2 00010000:00010000:1.0:1782487586.279604:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85d835 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1161 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.279625:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1155 00010000:00010000:1.0:1782487586.279645:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1160 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.279653:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.279656:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.279659:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00000100:00100000:1.0:1782487586.279690:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294589:x1869066294375168:12345-192.168.202.21@tcp:101:rm.500 Request processed in 659us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.279699:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27118 00000100:00100000:2.0:1782487586.279807:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294374912 00000100:00100000:2.0:1782487586.279812:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294374912 00000100:00100000:2.0:1782487586.279844:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16247 00000100:00100000:2.0:1782487586.279852:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2362:x1869066294374912:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:2.0:1782487586.279861:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.279874:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781dc expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.279889:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1857:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.279899:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.279903:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.279910:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 135 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.279922:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 135 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.279931:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587000, rc 0) 00000100:00100000:2.0:1782487586.279966:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2362:x1869066294374912:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 114us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.279973:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16247 00000100:00100000:2.0:1782487586.281879:0:190298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:190298:1869066299220736:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487586.281900:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.282724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.282770:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375680 00000100:00100000:2.0:1782487586.282776:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375680 00000100:00100000:2.0:1782487586.282804:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213700509288 time 7213700409288 state 0x1 ref 2 00000100:00100000:2.0:1782487586.282836:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213700509288 time 7213704225856 state 0x0 ref 2 00000100:00100000:2.0:1782487586.282848:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294578:x1869066294375680:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.282888:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.282908:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d71d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478173 expref: 1160 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.282928:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85d4ed lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb08:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780d9 expref: 1159 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.282941:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:2.0:1782487586.282952:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.282967:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.282979:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.282988:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283002:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283009:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283017:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283115:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283124:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283131:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.283641:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2552, 64 off171520 00010000:00010000:2.0:1782487586.283719:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283730:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283738:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283746:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283752:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283758:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283773:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.283788:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283795:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283805:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283811:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.283816:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283824:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283834:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb541321600) 00010000:00010000:2.0:1782487586.283837:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.283841:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283848:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d87b lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb08:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283855:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.283863:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283864:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283880:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb467570a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.283881:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283887:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283890:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283905:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283905:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.283912:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283923:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb08:0x0].0x0 (ffff9cb541321600) 00010000:00010000:2.0:1782487586.283924:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283929:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.283935:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283939:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.283946:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.283947:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85d882 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb08:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283950:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.283963:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d86d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283975:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1782487586.283976:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092baa9b6 reply state 00000000cc71fbc4 transno 8589956964 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.283980:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.283984:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487586.283988:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.284056:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294578:x1869066294375680:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1209us (1334us total) trans 8589956964 rc 0/0 00000100:00100000:2.0:1782487586.284066:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27119 00000100:00100000:3.0:1782487586.284228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.284482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.284483:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375296 00000100:00100000:2.0:1782487586.284489:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375296 00010000:00010000:2.0:1782487586.284513:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1160 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.284546:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6151 00000100:00100000:2.0:1782487586.284555:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:2361:x1869066294375296:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487586.284566:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.284572:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1160 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284589:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1160 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284745:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d293 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a478023 expref: 1160 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284761:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487586.284766:0:192468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284775:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284781:0:192468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284840:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487586.284873:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:2361:x1869066294375296:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 318us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.284881:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6151 00000100:00100000:2.0:1782487586.284908:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375424 00000100:00100000:2.0:1782487586.284912:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375424 00000100:00100000:2.0:1782487586.284943:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16248 00000100:00100000:2.0:1782487586.284951:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2361:x1869066294375424:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.284961:0:213223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.284973:0:213223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4781ff expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.284993:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.284998:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.285005:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 130 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285018:0:213223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 130 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285029:0:213223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb467571000, rc 0) 00000100:00100000:2.0:1782487586.285051:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+130:2361:x1869066294375424:12345-192.168.202.21@tcp:101:rm.500 Request processed in 100us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.285058:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16248 00010000:00010000:2.0:1782487586.285083:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285090:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285097:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285104:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.285108:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285115:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285129:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x814b4fa8 (ffff9cb541321d00) 00010000:00010000:2.0:1782487586.285133:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.285136:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.285143:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d874 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x814b4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285297:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285306:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.285901:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2553, 64 off171584 00010000:00010000:1.0:1782487586.285966:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285976:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285985:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285993:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.285999:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286005:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286024:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.286037:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286043:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286046:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.286050:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286057:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.286061:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286068:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286078:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:1.0:1782487586.286081:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.286085:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286095:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85d82e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286110:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286116:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286123:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286128:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.286132:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286139:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286148:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.286150:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.286154:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286160:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d820 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.286170:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f143e06 reply state 00000000e4d4b65b transno 8589956965 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.286177:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.286267:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+760:294563:x1869066294374784:12345-192.168.202.21@tcp:36:rm.500 Request processed in 7834us (8035us total) trans 8589956965 rc 0/0 00000100:00100000:1.0:1782487586.286276:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27117 00000100:00100000:1.0:1782487586.286283:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213700509288 time 7213704225856 state 0x2 ref 0 00010000:00010000:3.0:1782487586.286479:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286489:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.286493:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286501:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286519:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb46:0x0].0x0 (ffff9cb543a0d800) 00010000:00010000:3.0:1782487586.286525:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1782487586.286526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.286532:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286540:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85d890 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.286558:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.286561:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.286564:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487586.286590:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294375808 00000100:00100000:1.0:1782487586.286595:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294375808 00000100:00100000:1.0:1782487586.286683:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213700509288 time 7213704225856 state 0x0 ref 1 00000100:00100000:1.0:1782487586.286693:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213704325856 time 7213704225856 state 0x1 ref 1 00000100:00100000:1.0:1782487586.286745:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213704325856 time 7213708134776 state 0x0 ref 1 00000100:00100000:1.0:1782487586.286757:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1158:294591:x1869066294375808:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.286768:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.286778:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d897 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478206 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286817:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286826:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286835:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286848:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286855:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286863:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286933:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286941:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286950:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.286972:0:213935:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb0b:0x0]: returning size 0 00000004:00200000:1.0:1782487586.286976:0:213935:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.286988:0:213935:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.286998:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287005:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287012:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287018:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287024:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558d86800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.287028:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287036:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287047:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.287050:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.287054:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287059:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85d89e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287072:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287074:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287082:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287088:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287091:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287099:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578d71600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.287103:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287109:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287118:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487586.287121:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.287125:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287131:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85d8a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287139:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287148:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.287152:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287159:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287163:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85d897 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478206 expref: 1160 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287175:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487586.287180:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.287181:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478206 expref: 1159 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287185:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.287211:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d827 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.287212:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:1.0:1782487586.287219:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.287223:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1a00, rc 0) 00000100:00100000:1.0:1782487586.287255:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294591:x1869066294375808:12345-192.168.202.21@tcp:101:rm.500 Request processed in 501us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.287263:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27120 00000100:00100000:1.0:1782487586.287268:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213704325856 time 7213708134776 state 0x2 ref 0 00000100:00100000:2.0:1782487586.287973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.288043:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376064 00000100:00100000:1.0:1782487586.288048:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376064 00000100:00100000:1.0:1782487586.288063:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213704325856 time 7213708134776 state 0x0 ref 1 00000100:00100000:1.0:1782487586.288072:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213708234776 time 7213708134776 state 0x1 ref 1 00000100:00100000:1.0:1782487586.288119:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213708234776 time 7213709509360 state 0x0 ref 1 00000100:00100000:1.0:1782487586.288130:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294560:x1869066294376064:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.288157:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.288173:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85d3ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478069 expref: 759 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288192:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85d16d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477fa5 expref: 758 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288214:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb55a37b100) 00010000:00010000:1.0:1782487586.288226:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.288237:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288247:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288255:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288284:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288293:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288300:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.288315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.288382:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288391:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288403:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.288777:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2545, 64 off171072 00000004:00080000:1.0:1782487586.288785:0:190299:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7213710176556ns, next at 7214710174439ns, rc = 0 00010000:00010000:1.0:1782487586.288846:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288855:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288864:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288871:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288878:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288884:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288902:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.288913:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288920:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.288927:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.288927:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.288935:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288937:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.288943:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.288946:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.288953:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288956:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.288968:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288973:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.288977:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.288981:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.288988:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d8c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.288991:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb45:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:3.0:1782487586.288997:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.289001:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.289003:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.289009:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85d8c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.289015:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.289022:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.289027:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.289028:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.289031:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.289034:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.289035:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.289043:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.289057:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.289059:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.289063:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.289069:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85d8b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.289081:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088ac6837 reply state 000000009b9e63a5 transno 8589956966 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.289087:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.289131:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294560:x1869066294376064:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1002us (1158us total) trans 8589956966 rc 0/0 00000100:00100000:1.0:1782487586.289139:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27121 00000100:00100000:1.0:1782487586.289145:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213708234776 time 7213709509360 state 0x2 ref 0 00000100:00100000:2.0:1782487586.289277:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376192 00000100:00100000:2.0:1782487586.289282:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376192 00000100:00100000:2.0:1782487586.289318:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16249 00000100:00100000:2.0:1782487586.289327:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2363:x1869066294376192:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.289411:0:213221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.289425:0:213221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47820d expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.289444:0:213221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1858:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.289454:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.289459:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.289466:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 105 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289479:0:213221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 105 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289495:0:213221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d600, rc 0) 00000100:00100000:2.0:1782487586.289526:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2363:x1869066294376192:12345-192.168.202.21@tcp:101:rm.500 Request processed in 200us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.289534:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16249 00010000:00010000:2.0:1782487586.289766:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289775:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289781:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289787:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.289791:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289798:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289809:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.289812:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.289816:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.289822:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85d8ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.290965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.291446:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376448 00000100:00100000:2.0:1782487586.291452:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376448 00000100:00100000:2.0:1782487586.291471:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213708234776 time 7213709509360 state 0x0 ref 1 00000100:00100000:2.0:1782487586.291480:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213709609360 time 7213709509360 state 0x1 ref 1 00000100:00100000:2.0:1782487586.291498:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213709609360 time 7213712889070 state 0x0 ref 1 00000100:00100000:2.0:1782487586.291508:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294591:x1869066294376448:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.291535:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.291551:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85d8ac lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478206 expref: 1159 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291571:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85d6de lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478165 expref: 1158 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291583:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:2.0:1782487586.291593:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.291625:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291637:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291646:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291660:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291668:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291676:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291758:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291767:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.291775:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.292008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000040:00080000:2.0:1782487586.292172:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2546, 64 off171136 00010000:00010000:2.0:1782487586.292251:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292261:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292268:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292276:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292283:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292289:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292307:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487586.292317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.292323:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.292329:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.292336:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487586.292438:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376576 00000100:00100000:1.0:1782487586.292443:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376576 00000100:00100000:1.0:1782487586.292464:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213712989070 time 7213712889070 state 0x1 ref 2 00000100:00100000:1.0:1782487586.292488:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213712989070 time 7213713879105 state 0x0 ref 2 00000100:00100000:1.0:1782487586.292500:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294554:x1869066294376576:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.292510:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.292521:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d8f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478214 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292554:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292563:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292572:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292584:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292591:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292598:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292686:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292696:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292705:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.292727:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb42:0x0]: returning size 0 00000004:00200000:1.0:1782487586.292732:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.292743:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292753:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292765:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292771:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292778:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292783:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.292787:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292794:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292804:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.292808:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.292811:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292818:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d8f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292830:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292837:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292843:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292850:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.292854:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292861:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292870:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.292873:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.292876:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292883:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85d900 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292911:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d8f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478214 expref: 760 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292925:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478214 expref: 759 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.292932:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.292935:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.292938:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7600, rc 0) 00000100:00100000:1.0:1782487586.292979:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294554:x1869066294376576:12345-192.168.202.21@tcp:101:rm.500 Request processed in 481us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.292987:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27123 00010000:00010000:2.0:1782487586.293417:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293425:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293436:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.293439:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.293443:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293449:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d8eb lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293461:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.293464:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.293467:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487586.293482:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376704 00000100:00100000:2.0:1782487586.293486:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376704 00000100:00100000:2.0:1782487586.293523:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1156 00000100:00100000:2.0:1782487586.293531:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:2361:x1869066294376704:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487586.293550:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.293559:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d90e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47821b expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293584:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293594:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.293602:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.293998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.294090:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.294095:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294376960 00010000:00010000:2.0:1782487586.294100:0:190303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.294102:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294376960 00010000:00010000:2.0:1782487586.294112:0:190303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.294128:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213713979105 time 7213713879105 state 0x1 ref 2 00010000:00010000:2.0:1782487586.294129:0:190303:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294148:0:190303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294170:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294177:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294184:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294190:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.294195:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294215:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.294216:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213713979105 time 7213715605447 state 0x0 ref 2 00010000:00010000:2.0:1782487586.294236:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0b:0x0].0x0 (ffff9cb4a4c88900) 00000100:00100000:1.0:1782487586.294238:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+761:294554:x1869066294376960:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.294241:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.294247:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294255:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85d8e4 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb0b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294270:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.294278:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294286:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294289:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d907 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478214 expref: 761 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294299:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294308:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54151a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.294312:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294318:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294322:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85d0c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f74 expref: 760 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294334:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.294339:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.294345:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.294357:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294396:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.294402:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294407:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.294409:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d8d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294429:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.294433:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a24b311b reply state 000000001d727b63 transno 8589956967 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.294443:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.294445:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294454:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294463:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.294493:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:294591:x1869066294376448:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2985us (3529us total) trans 8589956967 rc 0/0 00000100:00100000:2.0:1782487586.294502:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27122 00010000:00010000:1.0:1782487586.294546:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294557:0:213935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1158 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294565:0:213935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294591:0:213935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1158 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.294812:0:213935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1158 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.294828:0:213935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220864:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487586.294899:0:213935:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4518e6780 going to sleep for 11 seconds 00010000:00010000:1.0:1782487586.295250:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295259:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295266:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295272:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f586400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.295276:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295284:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295294:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb541321600) 00010000:00010000:1.0:1782487586.295298:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.295301:0:3301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295309:0:3301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295316:0:3301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295345:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.295352:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85d8dd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295410:0:190303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295419:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295456:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295463:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295470:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295476:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5457d9000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.295480:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295491:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295501:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.295505:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.295509:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295515:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d915 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295526:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295532:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295539:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295544:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.295548:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295554:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295562:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x74204fa8 (ffff9cb541321600) 00010000:00010000:2.0:1782487586.295564:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.295568:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295575:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d91c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x74204fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295601:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d90e lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47821b expref: 759 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295629:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.295632:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.295638:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d90e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47821b expref: 759 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.295651:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc -2) 00000100:00100000:2.0:1782487586.295693:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:2361:x1869066294376704:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2162us (3377us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.295703:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1156 00000100:00100000:2.0:1782487586.296657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.296692:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294377216 00000100:00100000:1.0:1782487586.296698:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294377216 00000100:00100000:1.0:1782487586.296721:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213715705447 time 7213715605447 state 0x1 ref 2 00000100:00100000:1.0:1782487586.296745:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213715705447 time 7213718135288 state 0x0 ref 2 00000100:00100000:1.0:1782487586.296758:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1158:294592:x1869066294377216:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.296771:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.296782:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d938 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478245 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296865:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296876:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296885:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296898:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296906:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.296913:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.297240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.297277:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294377344 00000100:00100000:1.0:1782487586.297283:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294377344 00010000:00010000:1.0:1782487586.297305:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1160 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.297325:0:213935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:213935:1869066299220864:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487586.297344:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6152 00010000:00010000:2.0:1782487586.297351:0:213935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.297356:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:2363:x1869066294377344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.297369:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.297377:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1160 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297395:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1160 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297412:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d85f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781f8 expref: 1160 pid: 190299 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297425:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:1.0:1782487586.297430:0:192528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297437:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297444:0:192528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.297468:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.297490:0:213935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.297498:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.297505:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1159:2363:x1869066294377344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.297516:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6152 00000004:00080000:1.0:1782487586.297778:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187f:0x0], index 0: 0 00010000:00010000:1.0:1782487586.297992:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d94d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298002:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298011:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d94d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298047:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298055:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298061:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298069:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.298074:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298081:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298093:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.298096:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:2.0:1782487586.298097:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2554, 64 off171648 00010000:00010000:1.0:1782487586.298100:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298109:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d93f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.298122:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df75e37d reply state 000000002f304f46 transno 8589956968 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.298131:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.298158:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d938 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478245 expref: 1160 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298178:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298181:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d94d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478245 expref: 1159 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298213:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:2.0:1782487586.298214:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.298218:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.298223:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7600, rc 0) 00010000:00010000:2.0:1782487586.298229:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298239:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298246:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298253:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298269:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487586.298271:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294592:x1869066294377216:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1515us (1615us total) trans 8589956968 rc 0/0 00000100:00100000:1.0:1782487586.298282:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27125 00010000:00010000:2.0:1782487586.298283:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298292:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298299:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298302:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.298309:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.298312:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298314:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298329:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.298332:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298336:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298349:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:2.0:1782487586.298352:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.298355:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298357:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298362:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85d931 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298377:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb42:0x0].0x0 (ffff9cb486c9a000) 00010000:00010000:2.0:1782487586.298380:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298382:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.298388:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298388:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298405:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298407:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d95b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298410:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.298415:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.298421:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298428:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.298429:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.298432:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.298433:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.298436:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.298437:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.298443:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85d923 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.298455:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bec990ed reply state 00000000e08f0b88 transno 8589956969 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.298460:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.298495:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294554:x1869066294376960:12345-192.168.202.21@tcp:36:rm.500 Request processed in 4260us (4499us total) trans 8589956969 rc 0/0 00000100:00100000:2.0:1782487586.298504:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27124 00000100:00100000:2.0:1782487586.298509:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213715705447 time 7213718135288 state 0x2 ref 0 00010000:00010000:1.0:1782487586.300055:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300065:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300072:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300079:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.300084:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300092:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300104:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.300107:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.300112:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.300119:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d92a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300301:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300310:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300317:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300323:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.300327:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300335:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300350:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb5432e7600) 00010000:00010000:2.0:1782487586.300353:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.300357:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.300367:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85d946 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.307915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.307951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.307978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.308042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.308065:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294377600 00000100:00100000:1.0:1782487586.308074:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294377600 00000100:00100000:1.0:1782487586.308106:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213715705447 time 7213718135288 state 0x0 ref 1 00000100:00100000:1.0:1782487586.308119:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213718235288 time 7213718135288 state 0x1 ref 1 00000100:00100000:1.0:1782487586.308133:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294377856 00000100:00100000:1.0:1782487586.308136:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294377856 00000100:00100000:1.0:1782487586.308146:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213718235288 time 7213718135288 state 0x1 ref 2 00000100:00100000:1.0:1782487586.308157:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378240 00000100:00100000:1.0:1782487586.308159:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378240 00000100:00100000:1.0:1782487586.308167:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213718235288 time 7213718135288 state 0x1 ref 3 00000100:00100000:1.0:1782487586.308182:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213729672780 time 7213729572780 state 0x1 ref 3 00000100:00100000:1.0:1782487586.308193:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294555:x1869066294377600:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:2.0:1782487586.308250:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294377984 00000100:00100000:2.0:1782487586.308256:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294377984 00010000:00010000:1.0:1782487586.308257:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.308283:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85d381 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47805b expref: 759 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.308298:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1157 00000100:00100000:2.0:1782487586.308310:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:2360:x1869066294377984:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487586.308317:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85d0cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f82 expref: 758 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308321:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213729808817 time 7213729708817 state 0x1 ref 3 00010000:00010000:2.0:1782487586.308333:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.308334:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:1.0:1782487586.308347:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.308351:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d962 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47824c expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308360:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294592:x1869066294377856:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.308365:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308378:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308388:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308390:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.308392:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308406:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308406:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308412:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85d94d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478245 expref: 1160 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308426:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308430:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308453:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308457:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308460:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:2.0:1782487586.308471:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308474:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.308482:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308545:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308557:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308576:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308623:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308633:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308641:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.308662:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4c:0x0]: returning size 0 00000004:00200000:2.0:1782487586.308667:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.308680:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.308685:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308697:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308706:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308713:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.308749:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b67fd1ef reply state 00000000b2b82918 transno 8589956970 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308756:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.308793:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.308801:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308826:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1161:294592:x1869066294377856:12345-192.168.202.21@tcp:36:touch.500 Request processed in 479us (871us total) trans 8589956970 rc 0/0 00000100:00100000:3.0:1782487586.308835:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27127 00010000:00010000:2.0:1782487586.308844:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308852:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.308857:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308861:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213729808817 time 7213730250824 state 0x0 ref 2 00010000:00010000:2.0:1782487586.308874:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.308878:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1160:294596:x1869066294378240:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.308890:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.308893:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.308897:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.308899:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d99a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478253 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308902:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308915:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85d970 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308929:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308934:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308939:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308942:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.308944:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308949:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308958:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.308960:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.308963:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308967:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85d97e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.308992:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.308994:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85d962 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47824c expref: 759 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309017:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309019:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47824c expref: 758 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309028:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309029:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:2.0:1782487586.309036:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.309040:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb5457d9000, rc 0) 00010000:00010000:3.0:1782487586.309047:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309053:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309067:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.309070:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:2360:x1869066294377984:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 761us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.309085:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1157 00000040:00080000:1.0:1782487586.309254:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2547, 64 off171200 00010000:00010000:1.0:1782487586.309317:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309325:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309333:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309341:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309348:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309353:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309374:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.309386:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309392:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309398:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309404:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.309407:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309414:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309422:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.309425:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.309428:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309433:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d993 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309448:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309454:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309459:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309464:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.309467:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309472:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.309478:0:190298:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1859:0x0], index 1: 0 00010000:00010000:1.0:1782487586.309479:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.309483:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.309486:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.309500:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d969 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309502:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.309508:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.309513:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea955106 reply state 00000000e3237405 transno 8589956971 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309515:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.309521:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.309525:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.309530:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309539:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb43:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:2.0:1782487586.309541:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.309543:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309547:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85d9af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.309564:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.309566:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.309569:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.309653:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d9b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309664:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.309671:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+759:294555:x1869066294377600:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1477us (1761us total) trans 8589956971 rc 0/0 00010000:00010000:3.0:1782487586.309676:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.309681:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27126 00010000:00010000:3.0:1782487586.309711:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309719:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309726:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309733:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.309740:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309747:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309758:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.309761:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.309764:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309771:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85d9a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.309783:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004588b657 reply state 000000002dbfecb6 transno 8589956972 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.309790:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.309811:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85d99a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478253 expref: 1163 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309825:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478253 expref: 1162 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.309833:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.309836:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.309839:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00000100:00100000:3.0:1782487586.309869:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1163:294596:x1869066294378240:12345-192.168.202.21@tcp:101:touch.500 Request processed in 993us (1889us total) trans 8589956972 rc 0/0 00000100:00100000:3.0:1782487586.309878:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27128 00000100:00100000:3.0:1782487586.309883:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213729808817 time 7213730250824 state 0x2 ref 0 00010000:00010000:3.0:1782487586.311947:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.311959:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.311968:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.311975:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.311979:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.311987:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.311997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.312001:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487586.312006:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.312010:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.312018:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85d985 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.312032:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378368 00000100:00100000:2.0:1782487586.312039:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378368 00010000:00010000:3.0:1782487586.312043:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.312051:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.312064:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213729808817 time 7213730250824 state 0x0 ref 1 00000100:00100000:2.0:1782487586.312076:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213730350824 time 7213730250824 state 0x1 ref 1 00000100:00100000:2.0:1782487586.312106:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213730350824 time 7213733495875 state 0x0 ref 1 00000100:00100000:2.0:1782487586.312119:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1162:294592:x1869066294378368:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.312134:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.312150:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d9c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47825a expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.312188:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47825a expref: 1163 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.312215:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47825a expref: 1163 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.312233:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb541321600) 00010000:00010000:2.0:1782487586.312236:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.312239:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54151a000, rc 0) 00000100:00100000:2.0:1782487586.312270:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1163:294592:x1869066294378368:12345-192.168.202.21@tcp:101:touch.500 Request processed in 153us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.312278:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27129 00000100:00100000:2.0:1782487586.312282:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213730350824 time 7213733495875 state 0x2 ref 0 00010000:00010000:1.0:1782487586.312471:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312478:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312482:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312485:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.312487:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312491:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312497:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.312499:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.312501:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.312507:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85d977 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.314023:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.314034:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb558498600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.314039:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.314047:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.314060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.314061:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb4c5187900) 00010000:00010000:3.0:1782487586.314067:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.314071:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.314078:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85d9a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.314099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.314130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.314176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.314213:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378496 00000100:00100000:3.0:1782487586.314216:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378624 00000100:00100000:2.0:1782487586.314219:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378496 00000100:00100000:3.0:1782487586.314222:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378624 00000100:00100000:1.0:1782487586.314241:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378752 00000100:00100000:2.0:1782487586.314245:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213730350824 time 7213733495875 state 0x0 ref 1 00000100:00100000:1.0:1782487586.314246:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378752 00000100:00100000:3.0:1782487586.314249:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213733595875 time 7213733495875 state 0x1 ref 2 00000100:00100000:3.0:1782487586.314270:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294378880 00000100:00100000:3.0:1782487586.314273:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294378880 00000100:00100000:2.0:1782487586.314361:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213733595875 time 7213733495875 state 0x1 ref 4 00000100:00100000:2.0:1782487586.314387:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213735877558 time 7213735777558 state 0x1 ref 4 00000100:00100000:2.0:1782487586.314399:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+761:294581:x1869066294378624:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.314414:0:213684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.314428:0:213684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d9cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478268 expref: -99 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314482:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314494:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314504:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314524:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314532:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314540:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314849:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314860:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314869:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.314894:0:213684:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4a:0x0]: returning size 0 00000004:00200000:2.0:1782487586.314898:0:213684:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.314915:0:213684:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314926:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314935:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314942:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314952:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314959:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.314963:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314970:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314981:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.314984:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.314989:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.314995:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85d9d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315007:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315014:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315021:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315027:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.315032:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315042:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315052:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb54b3dcc00) 00010000:00010000:2.0:1782487586.315055:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.315058:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315065:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85d9d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315099:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85d9cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478268 expref: 763 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315114:0:213684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478268 expref: 762 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315122:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321c00) 00010000:00010000:2.0:1782487586.315125:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.315128:0:213684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00000100:00100000:1.0:1782487586.315274:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213735877558 time 7213735777558 state 0x1 ref 4 00000100:00100000:1.0:1782487586.315294:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213736784659 time 7213736684659 state 0x1 ref 4 00000100:00100000:1.0:1782487586.315305:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+762:294585:x1869066294378496:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.315313:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.315322:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d9e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478261 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315353:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315361:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315369:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315381:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315388:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315395:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.315418:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213736784659 time 7213736806956 state 0x0 ref 4 00000100:00100000:2.0:1782487586.315434:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:294583:x1869066294378752:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.315443:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.315446:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315455:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47826f expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315456:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315475:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.315493:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4d:0x0]: returning size 0 00000004:00200000:1.0:1782487586.315495:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.315499:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.315506:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315511:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315516:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315522:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315525:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315535:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315540:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315543:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315554:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315555:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.315560:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315568:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315570:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315587:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.315590:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.315593:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315598:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85d9ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315622:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315629:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315635:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315639:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.315642:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315647:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315654:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.315656:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.315659:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315664:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85d9f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315684:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85d9e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478261 expref: 765 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315697:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478261 expref: 764 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.315704:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:1.0:1782487586.315707:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.315709:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7800, rc 0) 00000100:00100000:1.0:1782487586.315738:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+764:294585:x1869066294378496:12345-192.168.202.21@tcp:101:rm.500 Request processed in 436us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.315745:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27131 00000100:00100000:1.0:1782487586.315806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.315814:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315842:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.315851:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.315876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.315888:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379008 00000100:00100000:1.0:1782487586.315891:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379008 00000004:00200000:2.0:1782487586.315906:0:213218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4b:0x0]: returning size 0 00000100:00100000:1.0:1782487586.315906:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213736906956 time 7213736806956 state 0x1 ref 4 00000004:00200000:2.0:1782487586.315912:0:213218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1782487586.315919:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379264 00000100:00100000:1.0:1782487586.315922:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379264 00000004:00010000:2.0:1782487586.315926:0:213218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315933:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213736906956 time 7213736806956 state 0x1 ref 5 00010000:00010000:2.0:1782487586.315938:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315941:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379392 00000100:00100000:1.0:1782487586.315945:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379392 00010000:00010000:2.0:1782487586.315955:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315956:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213736906956 time 7213736806956 state 0x1 ref 6 00010000:00010000:2.0:1782487586.315971:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315973:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737463483 time 7213737363483 state 0x1 ref 6 00010000:00010000:2.0:1782487586.315985:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.315990:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1163:294589:x1869066294379008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.315996:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.316001:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316001:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.316009:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316011:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47827d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316026:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.316030:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.316033:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316039:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85da0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316043:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316051:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316053:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316067:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316071:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316081:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316086:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316091:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.316099:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316099:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316117:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316118:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316137:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.316141:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.316144:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316150:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316154:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316162:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316178:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47826f expref: 765 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316180:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316191:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.316195:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47826f expref: 764 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316196:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316220:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316222:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb541321e00) 00010000:00010000:2.0:1782487586.316227:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.316230:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7c00, rc 0) 00010000:00010000:1.0:1782487586.316236:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.316240:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.316244:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316250:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85da26 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316262:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316263:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+764:294583:x1869066294378752:12345-192.168.202.21@tcp:101:rm.500 Request processed in 832us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.316277:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27132 00010000:00010000:1.0:1782487586.316278:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316286:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316291:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.316294:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316298:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737787498 time 7213737687498 state 0x1 ref 5 00010000:00010000:1.0:1782487586.316304:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316312:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1164:294596:x1869066294379264:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.316326:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xed314fa8 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.316329:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.316331:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316337:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85da2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xed314fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316340:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.316357:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85d9b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478253 expref: 1164 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316363:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da1f lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47827d expref: 1164 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.316370:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:1.0:1782487586.316374:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.316378:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.316379:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.316383:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47827d expref: 1163 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316395:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c6400, rc 0) 00000100:00100000:1.0:1782487586.316416:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1162:294589:x1869066294379008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 428us (609us total) trans 0 rc 301/301 00000100:00100000:1.0:1782487586.316423:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27133 00010000:00010000:2.0:1782487586.316432:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.316440:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737787498 time 7213737829418 state 0x0 ref 4 00010000:00010000:2.0:1782487586.316444:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.316452:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:294579:x1869066294379392:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.316456:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316460:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.316470:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478284 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316501:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316509:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316517:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316529:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316536:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316543:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.316579:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed1d2b4c reply state 00000000fa4d5e52 transno 8589956973 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316600:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316625:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316633:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.316650:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb49:0x0]: returning size 0 00000004:00200000:1.0:1782487586.316652:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.316661:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316663:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.316676:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316683:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316690:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316696:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316702:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.316705:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316715:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1163:294596:x1869066294379264:12345-192.168.202.21@tcp:36:touch.500 Request processed in 402us (852us total) trans 8589956973 rc 0/0 00010000:00010000:1.0:1782487586.316715:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316727:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.316730:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.316733:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.316737:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737929418 time 7213737829418 state 0x1 ref 4 00010000:00010000:1.0:1782487586.316742:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da42 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316754:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.316760:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737929418 time 7213738149883 state 0x0 ref 4 00010000:00010000:1.0:1782487586.316762:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316773:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.316781:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+764:294586:x1869066294378880:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.316781:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.316787:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.316793:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.316794:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316802:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb44297d300) 00010000:00010000:1.0:1782487586.316805:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.316806:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85da57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478276 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316808:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316824:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316847:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478284 expref: 766 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.316848:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.316861:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27134 00010000:00010000:3.0:1782487586.316872:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316875:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478284 expref: 765 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.316889:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.316889:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487586.316893:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.316897:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7400, rc 0) 00010000:00010000:3.0:1782487586.316913:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.316924:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.316924:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+765:294579:x1869066294379392:12345-192.168.202.21@tcp:101:rm.500 Request processed in 473us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.316936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.316945:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27135 00000100:00100000:1.0:1782487586.316965:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379520 00000100:00100000:1.0:1782487586.316969:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379520 00000100:00100000:1.0:1782487586.316998:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16250 00000100:00100000:1.0:1782487586.317007:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+130:2363:x1869066294379520:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.317107:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+764:294581:x1869066294378624:12345-192.168.202.21@tcp:101:rm.500 Request processed in 2710us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.317116:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27130 00000100:00100000:1.0:1782487586.317195:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+131:2363:x1869066294379520:12345-192.168.202.21@tcp:2:touch.500 Request processed in 189us (265us total) trans 8589940682 rc 0/0 00000100:00100000:1.0:1782487586.317213:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16250 00010000:00010000:3.0:1782487586.317217:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317293:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317304:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317313:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.317331:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0xb4c:0x0]: returning size 0 00000004:00200000:3.0:1782487586.317334:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487586.317345:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317355:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317363:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317370:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317377:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317382:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.317386:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317393:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317403:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.317406:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.317410:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317416:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85da5e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317428:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317435:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317442:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317447:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.317451:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317458:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317467:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4664e1600) 00010000:00010000:3.0:1782487586.317470:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.317474:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317480:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85da65 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317702:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85da57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478276 expref: 764 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317775:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478276 expref: 763 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.317785:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:3.0:1782487586.317788:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.317791:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498400, rc 0) 00000100:00100000:3.0:1782487586.317828:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:294586:x1869066294378880:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1052us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.317840:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27136 00000100:00100000:3.0:1782487586.317846:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737929418 time 7213738149883 state 0x2 ref 0 00000100:00100000:1.0:1782487586.319498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.319533:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379648 00000100:00100000:3.0:1782487586.319539:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379648 00000100:00100000:3.0:1782487586.319574:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1166 00000100:00100000:3.0:1782487586.319580:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:2361:x1869066294379648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487586.319591:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.319621:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85d9fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478261 expref: 763 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.319636:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487586.319639:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487586.319740:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+762:2361:x1869066294379648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 156us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.319751:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1166 00010000:00010000:1.0:1782487586.320290:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320300:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320307:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320313:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.320317:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320324:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320333:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:1.0:1782487586.320336:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.320340:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.320347:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85da34 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.323163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.323193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.323225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.323243:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294379904 00000100:00100000:2.0:1782487586.323252:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294379904 00000100:00100000:1.0:1782487586.323254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.323277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.323282:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213737929418 time 7213738149883 state 0x0 ref 1 00000100:00100000:2.0:1782487586.323295:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213738249883 time 7213738149883 state 0x1 ref 1 00000100:00100000:3.0:1782487586.323307:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380160 00000100:00100000:3.0:1782487586.323314:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380160 00000100:00100000:1.0:1782487586.323314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.323326:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380416 00000100:00100000:2.0:1782487586.323331:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380416 00000100:00100000:3.0:1782487586.323355:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380288 00000100:00100000:3.0:1782487586.323360:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380288 00000100:00100000:2.0:1782487586.323373:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380544 00000100:00100000:2.0:1782487586.323378:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380544 00000100:00100000:1.0:1782487586.323381:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1167 00000100:00100000:1.0:1782487586.323393:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+765:2363:x1869066294380160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.323406:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487586.323413:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1168 00000100:00100000:2.0:1782487586.323426:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+765:2363:x1869066294380416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.323428:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85da18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47826f expref: 765 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.323439:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.323446:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb541321e00) 00010000:00010000:1.0:1782487586.323451:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.323457:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85da6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478276 expref: 764 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.323461:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1169 00000100:00100000:3.0:1782487586.323478:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:2363:x1869066294380288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487586.323479:0:192468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:2.0:1782487586.323487:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.323488:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+763:2363:x1869066294380160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 96us (261us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.323492:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487586.323497:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1167 00010000:00010000:3.0:1782487586.323509:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85d9e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478268 expref: 763 pid: 213684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.323520:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1170 00000100:00100000:2.0:1782487586.323521:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+762:2363:x1869066294380416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 95us (264us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.323529:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321c00) 00000100:00100000:1.0:1782487586.323532:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+761:2363:x1869066294380544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487586.323534:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1168 00010000:00010000:3.0:1782487586.323537:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.323546:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.323559:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85da50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478284 expref: 760 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.323567:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+760:2363:x1869066294380288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.323585:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1169 00010000:00010000:1.0:1782487586.323587:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487586.323592:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.323642:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:2363:x1869066294380544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.323649:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1170 00000100:00100000:2.0:1782487586.323671:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380032 00000100:00100000:2.0:1782487586.323678:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380032 00000100:00100000:1.0:1782487586.323678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.323697:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213738249883 time 7213738149883 state 0x1 ref 2 00000100:00100000:1.0:1782487586.323701:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294380800 00000100:00100000:1.0:1782487586.323706:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294380800 00000100:00100000:2.0:1782487586.323722:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745211037 time 7213745111037 state 0x1 ref 2 00000100:00100000:2.0:1782487586.323748:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1163:294599:x1869066294379904:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.323767:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.323780:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85da73 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47828b expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.323824:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745211037 time 7213745111037 state 0x1 ref 3 00000100:00100000:1.0:1782487586.323851:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745341727 time 7213745241727 state 0x1 ref 3 00000100:00100000:1.0:1782487586.323862:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1164:294596:x1869066294380032:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.323871:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.323881:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da7a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478292 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.323918:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.323918:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478292 expref: 1165 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.323940:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.323944:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478292 expref: 1165 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.323957:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.323968:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:2.0:1782487586.323973:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.323973:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.323978:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7600, rc 0) 00010000:00010000:2.0:1782487586.323985:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.323995:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.324010:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1165:294596:x1869066294380032:12345-192.168.202.21@tcp:101:touch.500 Request processed in 149us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.324017:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27138 00000100:00100000:1.0:1782487586.324035:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745341727 time 7213745425862 state 0x0 ref 2 00000100:00100000:1.0:1782487586.324044:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294579:x1869066294380800:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.324065:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.324077:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85d755 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478188 expref: 758 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324093:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85d4f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780e0 expref: 757 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324101:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487586.324107:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.324117:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324126:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324133:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324146:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324153:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324160:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324248:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324255:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324262:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.324574:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1880:0x0], index 0: 0 00000040:00080000:1.0:1782487586.324663:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2548, 64 off171264 00010000:00010000:1.0:1782487586.324727:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324736:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324744:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324753:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324759:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324766:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324778:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85daab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324779:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.324793:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85daab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324796:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324805:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85daab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324806:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324823:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324829:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.324833:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324840:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324848:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324849:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.324855:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.324860:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324862:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324876:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85da9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324878:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.324893:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.324897:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324898:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324910:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.324916:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.324990:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.324997:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.325006:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.325010:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.325019:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.325031:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb49:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:3.0:1782487586.325034:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.325038:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.325044:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85daa4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb49:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.325062:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.325065:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.325068:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.325302:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.325316:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.325319:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.325324:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.325331:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85da81 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.325344:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b98d4142 reply state 0000000051f10ef2 transno 8589956975 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.325353:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.325381:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85da73 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47828b expref: 1166 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.325401:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85daab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47828b expref: 1165 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.325408:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.325411:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.325414:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd07000, rc 0) 00000100:00100000:2.0:1782487586.325449:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1166:294599:x1869066294379904:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1702us (2291us total) trans 8589956975 rc 0/0 00000100:00100000:2.0:1782487586.325456:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27137 00010000:00010000:1.0:1782487586.326359:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.326364:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.326372:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.326382:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.326385:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.326388:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.326394:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85da8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.326405:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000aea1a41 reply state 000000001bd351a7 transno 8589956974 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.326412:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.326451:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+758:294579:x1869066294380800:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2407us (2774us total) trans 8589956974 rc 0/0 00000100:00100000:1.0:1782487586.326458:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27139 00000100:00100000:1.0:1782487586.326464:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745341727 time 7213745425862 state 0x2 ref 0 00000100:00100000:1.0:1782487586.326520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.326694:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381056 00000100:00100000:2.0:1782487586.326700:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381056 00000100:00100000:2.0:1782487586.326788:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5793 00000100:00100000:2.0:1782487586.326799:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1166:294592:x1869066294381056:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.327013:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294592:x1869066294381056:12345-192.168.202.21@tcp:35:touch.500 Request processed in 216us (491us total) trans 8589956976 rc 0/0 00000100:00100000:2.0:1782487586.327022:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5793 00000100:00100000:3.0:1782487586.329345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.329345:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329359:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329368:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329375:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.329381:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329389:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.329399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.329405:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.329409:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.329413:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329420:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85da88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.329455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.329483:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381312 00000100:00100000:3.0:1782487586.329488:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381568 00000100:00100000:2.0:1782487586.329490:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381312 00000100:00100000:3.0:1782487586.329495:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381568 00000100:00100000:2.0:1782487586.329517:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745341727 time 7213745425862 state 0x0 ref 1 00000100:00100000:2.0:1782487586.329528:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745525862 time 7213745425862 state 0x1 ref 1 00000100:00100000:2.0:1782487586.329549:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213745525862 time 7213750939474 state 0x0 ref 1 00000100:00100000:3.0:1782487586.329562:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213751039474 time 7213750939474 state 0x1 ref 2 00000100:00100000:2.0:1782487586.329563:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294597:x1869066294381312:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.329582:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.329593:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213751039474 time 7213750982555 state 0x0 ref 2 00000100:00100000:3.0:1782487586.329634:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294599:x1869066294381568:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:1.0:1782487586.329654:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381184 00000100:00100000:1.0:1782487586.329660:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381184 00010000:00010000:3.0:1782487586.329669:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.329689:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85daab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47828b expref: 1167 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.329694:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16251 00000100:00100000:1.0:1782487586.329707:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2360:x1869066294381184:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:3.0:1782487586.329708:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb4c9e2fe00) 00010000:00010000:2.0:1782487586.329710:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dab9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478299 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.329719:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.329776:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.329779:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329801:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.329802:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329824:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.329825:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329855:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329863:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329872:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.329926:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2360:x1869066294381184:12345-192.168.202.21@tcp:2:touch.500 Request processed in 222us (587us total) trans 8589940019 rc 0/0 00010000:00010000:2.0:1782487586.329941:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.329945:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16251 00010000:00010000:2.0:1782487586.329954:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.329958:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2c1845d reply state 00000000beaf5e17 transno 8589956977 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329962:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.329977:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.329979:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.329984:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.329992:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330002:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.330006:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.330009:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330016:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dac0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330029:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330036:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330043:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330049:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.330052:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330059:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330069:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.330072:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.330075:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330082:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dace lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330116:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dab9 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478299 expref: 1169 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.330117:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1169:294599:x1869066294381568:12345-192.168.202.21@tcp:36:touch.500 Request processed in 510us (659us total) trans 8589956977 rc 0/0 00000100:00100000:3.0:1782487586.330141:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27141 00010000:00010000:2.0:1782487586.330142:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.330147:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.330153:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dab9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478299 expref: 1169 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.330165:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb400, rc 0) 00000100:00100000:2.0:1782487586.330193:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294597:x1869066294381312:12345-192.168.202.21@tcp:101:rm.500 Request processed in 633us (796us total) trans 0 rc 301/301 00010000:00010000:3.0:1782487586.330366:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.330376:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.330385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.330388:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.330396:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.330400:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.330404:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381824 00010000:00010000:3.0:1782487586.330410:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.330410:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381824 00010000:00010000:3.0:1782487586.330425:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.330428:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.330432:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.330439:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85da96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.330765:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27140 00010000:00010000:2.0:1782487586.331186:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331195:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331213:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331219:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.331224:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331231:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331242:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.331245:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.331249:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.331256:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dac7 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.332019:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213751082555 time 7213750982555 state 0x1 ref 1 00000100:00100000:1.0:1782487586.332049:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213751082555 time 7213753439135 state 0x0 ref 1 00000100:00100000:1.0:1782487586.332062:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:294572:x1869066294381824:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.332095:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.332111:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85d62f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478134 expref: 757 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332128:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85d2cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478031 expref: 756 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332138:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb541321800) 00010000:00010000:1.0:1782487586.332145:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.332294:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.332345:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332357:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332365:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332379:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332386:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332392:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332476:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332483:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332495:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.332900:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2555, 64 off171712 00010000:00010000:1.0:1782487586.332957:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332966:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332974:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332982:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332988:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.332995:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333012:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.333025:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333031:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333032:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.333038:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333041:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333050:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.333052:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.333054:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333057:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333063:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333066:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333075:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:3.0:1782487586.333079:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.333081:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333085:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb47:0x0].0x0 (ffff9cb5432e7600) 00010000:00010000:3.0:1782487586.333086:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85daea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333091:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.333096:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333101:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.333103:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dae3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.333105:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.333109:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.333122:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333133:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333139:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333144:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.333146:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333152:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333158:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.333160:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.333163:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.333177:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dad5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.333186:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075ba015a reply state 00000000b2ecd502 transno 8589956978 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.333193:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.333252:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+757:294572:x1869066294381824:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1193us (2869us total) trans 8589956978 rc 0/0 00000100:00100000:1.0:1782487586.333259:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27142 00000100:00100000:1.0:1782487586.333265:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213751082555 time 7213753439135 state 0x2 ref 0 00000100:00100000:1.0:1782487586.333288:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294381952 00000100:00100000:1.0:1782487586.333292:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294381952 00000100:00100000:1.0:1782487586.333307:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213751082555 time 7213753439135 state 0x0 ref 1 00000100:00100000:1.0:1782487586.333314:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213753539135 time 7213753439135 state 0x1 ref 1 00000100:00100000:2.0:1782487586.333452:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213753539135 time 7213754841354 state 0x0 ref 1 00000100:00100000:2.0:1782487586.333463:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1166:294599:x1869066294381952:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.333474:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.333485:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85daf1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782a0 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.333515:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85daf1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782a0 expref: 1167 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.333526:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85daf1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782a0 expref: 1167 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.333541:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:2.0:1782487586.333544:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.333546:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4000, rc 0) 00000100:00100000:2.0:1782487586.333573:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294599:x1869066294381952:12345-192.168.202.21@tcp:101:touch.500 Request processed in 112us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.333579:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27143 00000100:00100000:2.0:1782487586.333583:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213753539135 time 7213754841354 state 0x2 ref 0 00000100:00100000:1.0:1782487586.333921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.334004:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294382080 00000100:00100000:3.0:1782487586.334009:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294382080 00000100:00100000:3.0:1782487586.334030:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213753539135 time 7213754841354 state 0x0 ref 1 00000100:00100000:3.0:1782487586.334039:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213754941354 time 7213754841354 state 0x1 ref 1 00000100:00100000:3.0:1782487586.334068:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213754941354 time 7213755457350 state 0x0 ref 1 00000100:00100000:3.0:1782487586.334081:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1167:294597:x1869066294382080:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.334092:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.334103:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85daf8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782a7 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334148:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334158:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334168:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334186:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334195:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334478:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334530:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334537:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334544:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.334552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.334555:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.334560:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334569:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334579:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.334582:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.334586:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334592:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85daff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334626:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334635:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334635:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334650:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334653:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334664:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334671:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.334673:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.334676:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334678:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334692:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334694:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334707:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x15f74fa8 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.334711:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.334712:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb5432e7300) 00010000:00010000:3.0:1782487586.334715:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334717:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.334722:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334725:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x15f74fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.334737:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dadc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334766:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85daf8 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782a7 expref: 1168 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334777:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.334780:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.334785:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85daf8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782a7 expref: 1168 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.334798:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7a00, rc 0) 00000100:00100000:3.0:1782487586.334818:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294382336 00000100:00100000:3.0:1782487586.334822:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294382336 00000100:00100000:3.0:1782487586.334852:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5794 00000100:00100000:3.0:1782487586.334858:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1168:294596:x1869066294382336:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.335058:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1169:294596:x1869066294382336:12345-192.168.202.21@tcp:35:touch.500 Request processed in 199us (508us total) trans 8589956979 rc 0/0 00000100:00100000:3.0:1782487586.335064:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5794 00000100:00100000:3.0:1782487586.335093:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1168:294597:x1869066294382080:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1018us (1174us total) trans 0 rc 301/301 00000100:00100000:3.0:1782487586.335099:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27144 00000100:00100000:3.0:1782487586.335103:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213754941354 time 7213755457350 state 0x2 ref 0 00000100:00100000:1.0:1782487586.340374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.340458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.340482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.340546:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294382592 00000100:00100000:2.0:1782487586.340556:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294382592 00000100:00100000:3.0:1782487586.340564:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294382720 00000100:00100000:3.0:1782487586.340570:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294382720 00000100:00100000:2.0:1782487586.340590:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213754941354 time 7213755457350 state 0x0 ref 1 00000100:00100000:2.0:1782487586.340603:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213755557350 time 7213755457350 state 0x1 ref 1 00000100:00100000:3.0:1782487586.340639:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16252 00000100:00100000:3.0:1782487586.340652:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+131:2363:x1869066294382720:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.340747:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294382976 00000100:00100000:2.0:1782487586.340751:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294382976 00000100:00100000:2.0:1782487586.340767:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213755557350 time 7213755457350 state 0x1 ref 2 00000100:00100000:1.0:1782487586.340799:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762287986 time 7213762187986 state 0x1 ref 2 00000100:00100000:1.0:1782487586.340810:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294576:x1869066294382592:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.340861:0:196437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.340883:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85d60c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47812d expref: 756 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.340906:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85d342 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47804d expref: 755 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.340917:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb543a0d200) 00010000:00010000:1.0:1782487586.340925:0:196437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.340943:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.340954:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.340963:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.340972:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54765ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2363:x1869066294382720:12345-192.168.202.21@tcp:2:touch.500 Request processed in 321us (510us total) trans 8589940683 rc 0/0 00010000:00010000:1.0:1782487586.340978:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.340985:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16252 00010000:00010000:1.0:1782487586.340991:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341000:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.341024:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762287986 time 7213762412348 state 0x0 ref 2 00000100:00100000:3.0:1782487586.341037:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1168:294603:x1869066294382976:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.341052:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.341066:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85db1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782ae expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341147:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341159:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341167:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341177:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341182:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341187:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341340:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341349:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341357:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.341714:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185a:0x0], index 1: 0 00000040:00080000:1.0:1782487586.341900:0:196437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2549, 64 off171328 00010000:00010000:3.0:1782487586.341906:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db37 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341914:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341920:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341946:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341948:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341962:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341964:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341969:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341977:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.341978:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341983:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.341989:0:196437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.341990:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342006:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342009:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.342015:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.342016:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342018:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342030:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85db22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.342037:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9833d5d reply state 000000009ecadcd3 transno 8589956980 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342042:0:196437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487586.342049:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.342057:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342060:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.342067:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342068:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342088:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.342089:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342093:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342102:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.342104:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342107:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342111:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.342114:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.342117:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342120:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342122:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85db45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342143:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.342143:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb48:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.342147:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.342147:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.342149:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.342152:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342159:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db30 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342170:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85db1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ae expref: 1171 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342185:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ae expref: 1170 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342188:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342190:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.342196:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.342209:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.342211:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afc00, rc 0) 00010000:00010000:1.0:1782487586.342219:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342233:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.342236:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.342242:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1171:294603:x1869066294382976:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1208us (1758us total) trans 8589956980 rc 0/0 00010000:00010000:1.0:1782487586.342248:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.342255:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27146 00010000:00010000:1.0:1782487586.342264:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.342267:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.342271:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.342276:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.342285:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064fb8e35 reply state 000000001ebcaf38 transno 8589956981 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.342291:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.342320:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294576:x1869066294382592:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1511us (1954us total) trans 8589956981 rc 0/0 00000100:00100000:1.0:1782487586.342326:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27145 00000100:00100000:1.0:1782487586.342330:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762287986 time 7213762412348 state 0x2 ref 0 00010000:00010000:2.0:1782487586.343126:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343135:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343141:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343146:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.343150:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343156:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343165:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4c5187900) 00010000:00010000:2.0:1782487586.343231:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.343235:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343241:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85db29 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343351:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343359:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343369:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343374:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.343377:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343383:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343392:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.343394:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.343397:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.343403:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.343666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.343732:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294383232 00000100:00100000:2.0:1782487586.343738:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294383232 00000100:00100000:2.0:1782487586.343761:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762287986 time 7213762412348 state 0x0 ref 1 00000100:00100000:2.0:1782487586.343770:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762512348 time 7213762412348 state 0x1 ref 1 00000100:00100000:2.0:1782487586.343795:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762512348 time 7213765185507 state 0x0 ref 1 00000100:00100000:2.0:1782487586.343804:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1170:294603:x1869066294383232:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.343847:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.343860:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85db37 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ae expref: 1170 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343871:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.343877:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.343928:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343937:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.343944:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.344026:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027564ad1 reply state 0000000018d774c5 transno 8589956982 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.344034:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.344089:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44c0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1171:294603:x1869066294383232:12345-192.168.202.21@tcp:36:touch.500 Request processed in 286us (425us total) trans 8589956982 rc 0/0 00000100:00100000:2.0:1782487586.344096:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27147 00000100:00100000:2.0:1782487586.344100:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762512348 time 7213765185507 state 0x2 ref 0 00000100:00100000:1.0:1782487586.344310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.344339:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294383488 00000100:00100000:1.0:1782487586.344340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.344345:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294383488 00000100:00100000:3.0:1782487586.344361:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213762512348 time 7213765185507 state 0x0 ref 1 00000100:00100000:3.0:1782487586.344368:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765285507 time 7213765185507 state 0x1 ref 1 00000100:00100000:3.0:1782487586.344393:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765285507 time 7213765784451 state 0x0 ref 1 00000100:00100000:2.0:1782487586.344394:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294383616 00000100:00100000:2.0:1782487586.344400:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294383616 00000100:00100000:3.0:1782487586.344405:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:294585:x1869066294383488:12345-192.168.202.21@tcp:36:rm.500 00000100:00100000:2.0:1782487586.344431:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1158 00010000:00010000:3.0:1782487586.344433:0:213218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1782487586.344441:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+756:2363:x1869066294383616:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487586.344452:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85d78d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478196 expref: 756 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344461:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.344472:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85db53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782b5 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.344475:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85d68a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478150 expref: 755 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.344494:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487586.344505:0:213218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.344512:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.344516:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344524:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344533:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344589:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344597:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.344662:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345076:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345089:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345089:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345104:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345110:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345113:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345116:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.345122:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345127:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345130:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345142:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345146:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.345152:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.345155:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345161:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85db5a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.345259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.345277:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294383872 00000100:00100000:1.0:1782487586.345280:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294383872 00000100:00100000:1.0:1782487586.345304:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5795 00000100:00100000:1.0:1782487586.345310:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1171:294599:x1869066294383872:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:3.0:1782487586.345464:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.345475:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.345483:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1172:294599:x1869066294383872:12345-192.168.202.21@tcp:35:touch.500 Request processed in 171us (222us total) trans 8589956983 rc 0/0 00010000:00010000:3.0:1782487586.345485:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.345503:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5795 00000100:00100000:1.0:1782487586.345600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.345662:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345670:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345676:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345682:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.345685:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345691:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345700:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc8ef95a8 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.345703:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.345706:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345712:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85db68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc8ef95a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345738:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85db53 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782b5 expref: 755 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345747:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.345750:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.345754:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85db53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782b5 expref: 755 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345763:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb4800, rc -2) 00000100:00100000:2.0:1782487586.345820:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:2363:x1869066294383616:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 1381us (1480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.345827:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1158 00010000:00010000:2.0:1782487586.345861:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345868:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345875:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345880:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.345884:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345890:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345898:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.345900:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.345903:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.345909:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85db4c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.345931:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294384000 00000100:00100000:2.0:1782487586.345935:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294384000 00000100:00100000:2.0:1782487586.345951:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765884451 time 7213765784451 state 0x1 ref 2 00000100:00100000:2.0:1782487586.345968:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765884451 time 7213767358822 state 0x0 ref 2 00000100:00100000:2.0:1782487586.345978:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1171:294603:x1869066294384000:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.345987:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.345998:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85db7d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782bc expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346024:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85db7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782bc expref: 1172 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346034:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85db7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782bc expref: 1172 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346049:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487586.346051:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.346054:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb546d37200, rc 0) 00000040:00080000:3.0:1782487586.346164:0:213218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2556, 64 off171776 00000100:00100000:2.0:1782487586.346244:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1172:294603:x1869066294384000:12345-192.168.202.21@tcp:101:touch.500 Request processed in 267us (643us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.346247:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.346256:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27149 00010000:00010000:3.0:1782487586.346263:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346272:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346281:0:213218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346287:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346294:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346519:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.346525:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346532:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.346534:0:213218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782487586.346535:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346545:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346551:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346559:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346565:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346570:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.346574:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.346578:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346581:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.346587:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.346589:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7c00/0x66475b4e8b85db84 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346603:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346634:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4d:0x0].0x0 (ffff9cb4c9e2fc00) 00010000:00010000:2.0:1782487586.346636:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.346638:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.346640:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.346642:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.346643:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346651:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85db76 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346903:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346911:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346922:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346928:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.346932:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346939:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346949:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.346953:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.346956:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.346962:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85db61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.346974:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6030aec reply state 000000006e60853e transno 8589956984 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.346981:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.347226:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+755:294585:x1869066294383488:12345-192.168.202.21@tcp:36:rm.500 Request processed in 2820us (2914us total) trans 8589956984 rc 0/0 00000100:00100000:3.0:1782487586.347235:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27148 00000100:00100000:3.0:1782487586.347241:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765884451 time 7213767358822 state 0x2 ref 0 00000100:00100000:3.0:1782487586.347895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.348276:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294384128 00000100:00100000:2.0:1782487586.348282:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294384128 00000100:00100000:2.0:1782487586.348319:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16253 00000100:00100000:2.0:1782487586.348327:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2361:x1869066294384128:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.348516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.348516:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2361:x1869066294384128:12345-192.168.202.21@tcp:2:touch.500 Request processed in 187us (620us total) trans 8589940020 rc 0/0 00000100:00100000:2.0:1782487586.348526:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16253 00010000:00010000:1.0:1782487586.348624:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348634:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348641:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348646:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.348650:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348656:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348665:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c5187400) 00010000:00010000:1.0:1782487586.348668:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.348672:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348678:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85db6f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.348705:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294384384 00000100:00100000:1.0:1782487586.348709:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294384384 00000100:00100000:1.0:1782487586.348727:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213765884451 time 7213767358822 state 0x0 ref 1 00000100:00100000:1.0:1782487586.348737:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213767458822 time 7213767358822 state 0x1 ref 1 00000100:00100000:1.0:1782487586.348772:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213767458822 time 7213770162175 state 0x0 ref 1 00000100:00100000:1.0:1782487586.348783:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294583:x1869066294384384:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.348814:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.348827:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85d771 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47818f expref: 754 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348842:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85d5e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47811f expref: 753 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348851:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb541321e00) 00010000:00010000:1.0:1782487586.348856:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.348869:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348879:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348887:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348899:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348905:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348911:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.348996:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349004:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349011:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.349399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000040:00080000:1.0:1782487586.349469:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2557, 64 off171840 00010000:00010000:1.0:1782487586.349512:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349521:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349529:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349536:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349542:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349548:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.349588:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294384640 00000100:00100000:2.0:1782487586.349600:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294384640 00000100:00100000:2.0:1782487586.349671:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5796 00000100:00100000:2.0:1782487586.349678:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1172:294603:x1869066294384640:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.349859:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1173:294603:x1869066294384640:12345-192.168.202.21@tcp:35:touch.500 Request processed in 180us (461us total) trans 8589956986 rc 0/0 00000100:00100000:2.0:1782487586.349866:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5796 00010000:00010000:1.0:1782487586.349916:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.349929:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.349935:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349938:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349952:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.349959:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.349959:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.349965:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.349968:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.349974:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.349975:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.349997:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.349998:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350001:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.350005:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350012:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dba0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350013:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4b:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.350020:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.350024:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350026:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.350030:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.350032:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85db99 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350033:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.350051:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350057:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350063:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350068:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.350071:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350078:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350085:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.350087:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.350090:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.350095:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85db8b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.350104:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001517c068 reply state 000000006a800059 transno 8589956985 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.350112:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.350138:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+754:294583:x1869066294384384:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1357us (1627us total) trans 8589956985 rc 0/0 00000100:00100000:1.0:1782487586.350146:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27150 00000100:00100000:1.0:1782487586.350151:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213767458822 time 7213770162175 state 0x2 ref 0 00010000:00010000:3.0:1782487586.350926:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350936:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350942:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350948:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.350954:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350961:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350973:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5432e7600) 00010000:00010000:3.0:1782487586.350976:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.350980:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.350987:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85db92 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.352464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.352509:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294385024 00000100:00100000:2.0:1782487586.352515:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294385024 00000100:00100000:2.0:1782487586.352537:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213767458822 time 7213770162175 state 0x0 ref 1 00000100:00100000:2.0:1782487586.352548:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213770262175 time 7213770162175 state 0x1 ref 1 00000100:00100000:2.0:1782487586.352604:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213770262175 time 7213773993928 state 0x0 ref 1 00000100:00100000:2.0:1782487586.352631:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+753:294581:x1869066294385024:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.352666:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.352683:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85d739 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478181 expref: 753 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.352698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.352704:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85d587 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47810a expref: 752 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352715:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb541321c00) 00010000:00010000:2.0:1782487586.352721:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.352738:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352748:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352757:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352769:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352776:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.352783:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.352854:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294384768 00000100:00100000:1.0:1782487586.352858:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294384768 00000100:00100000:1.0:1782487586.352873:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774093928 time 7213773993928 state 0x1 ref 2 00000100:00100000:1.0:1782487586.352891:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774093928 time 7213774282561 state 0x0 ref 2 00000100:00100000:1.0:1782487586.352900:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1173:294617:x1869066294384768:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.352909:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.352919:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dbb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782c3 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352951:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352960:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352968:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352978:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352985:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.352992:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353184:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353192:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353208:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.353232:0:190298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb0d:0x0]: returning size 0 00000004:00200000:1.0:1782487586.353235:0:190298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.353248:0:190298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353259:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353266:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353273:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353279:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353285:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.353288:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353295:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353302:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.353305:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.353308:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353314:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dbbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353325:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353330:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353337:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353342:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.353345:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353350:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353356:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.353358:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.353361:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353366:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dbc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353386:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dbb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782c3 expref: 1175 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353397:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782c3 expref: 1174 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.353404:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb541321600) 00010000:00010000:1.0:1782487586.353407:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.353409:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7800, rc 0) 00000100:00100000:1.0:1782487586.353447:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1174:294617:x1869066294384768:12345-192.168.202.21@tcp:101:rm.500 Request processed in 548us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.353459:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27152 00010000:00010000:2.0:1782487586.353584:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.353594:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.353602:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.354030:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2550, 64 off171392 00010000:00010000:2.0:1782487586.354074:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354084:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354092:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354100:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354106:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354111:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354128:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.354138:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354144:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354155:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354159:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4683ca600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.354162:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354163:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487586.354169:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354176:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.354179:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354185:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354193:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:3.0:1782487586.354195:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.354198:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354215:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dbd8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.354224:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.354226:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.354229:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.354237:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354247:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4a:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487586.354249:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.354253:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354259:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85dbd1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354275:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354281:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354287:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354292:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb5200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.354295:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354306:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354313:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.354315:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.354317:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.354323:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dba7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.354331:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085a1f272 reply state 00000000b1a00d74 transno 8589956987 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.354339:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.354377:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+753:294581:x1869066294385024:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1749us (1917us total) trans 8589956987 rc 0/0 00000100:00100000:2.0:1782487586.354384:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27151 00000100:00100000:2.0:1782487586.354389:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774093928 time 7213774282561 state 0x2 ref 0 00010000:00010000:1.0:1782487586.355096:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355105:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355111:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355116:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.355119:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355126:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355134:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4549e8600) 00010000:00010000:1.0:1782487586.355136:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.355139:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.355146:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dbae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.356383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.356423:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294385280 00000100:00100000:2.0:1782487586.356430:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294385280 00000100:00100000:2.0:1782487586.356451:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774093928 time 7213774282561 state 0x0 ref 1 00000100:00100000:2.0:1782487586.356462:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774382561 time 7213774282561 state 0x1 ref 1 00000100:00100000:2.0:1782487586.356511:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774382561 time 7213777901771 state 0x0 ref 1 00000100:00100000:2.0:1782487586.356522:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1174:294605:x1869066294385280:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.356539:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.356550:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dbdf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782ca expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356657:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356669:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356678:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356689:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356696:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.356702:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.357040:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1881:0x0], index 0: 0 00010000:00010000:2.0:1782487586.357162:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85dbf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357183:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85dbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357191:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85dbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357232:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357239:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357246:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357251:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.357254:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357260:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357269:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.357271:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.357275:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357281:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dbe6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.357292:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c1ee708 reply state 0000000050e0f938 transno 8589956988 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.357298:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.357318:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dbdf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ca expref: 1177 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357336:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85dbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ca expref: 1176 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.357343:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.357346:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.357348:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0da00, rc 0) 00000100:00100000:2.0:1782487586.357388:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1177:294605:x1869066294385280:12345-192.168.202.21@tcp:101:touch.500 Request processed in 867us (1010us total) trans 8589956988 rc 0/0 00000100:00100000:2.0:1782487586.357396:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27153 00000100:00100000:2.0:1782487586.357400:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774382561 time 7213777901771 state 0x2 ref 0 00000100:00100000:3.0:1782487586.357786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.357818:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294385536 00000100:00100000:1.0:1782487586.357824:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294385536 00000100:00100000:1.0:1782487586.357841:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213774382561 time 7213777901771 state 0x0 ref 1 00000100:00100000:1.0:1782487586.357849:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213778001771 time 7213777901771 state 0x1 ref 1 00000100:00100000:1.0:1782487586.357872:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213778001771 time 7213779262748 state 0x0 ref 1 00000100:00100000:1.0:1782487586.357880:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+752:294586:x1869066294385536:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.357907:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782487586.357920:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85d98c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47824c expref: 752 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357934:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85d7b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47819d expref: 751 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357946:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85d5f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478126 expref: 750 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357957:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:1.0:1782487586.357963:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.357973:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357982:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357989:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.357999:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358005:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358017:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358073:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358080:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358087:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.358443:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2551, 64 off171456 00010000:00010000:1.0:1782487586.358484:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358492:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358500:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358507:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358513:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358519:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358536:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.358547:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358554:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358557:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.358560:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358564:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358569:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.358575:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358576:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.358583:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358586:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358597:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358601:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:1.0:1782487586.358626:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.358629:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358636:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc10 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358648:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358654:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358660:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358670:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.358673:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358679:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358686:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.358688:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.358690:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.358695:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc02 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.358704:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000653edfc9 reply state 0000000097b6506b transno 8589956989 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.358711:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.358750:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e7cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+751:294586:x1869066294385536:12345-192.168.202.21@tcp:36:rm.500 Request processed in 870us (966us total) trans 8589956989 rc 0/0 00000100:00100000:1.0:1782487586.358758:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27154 00000100:00100000:1.0:1782487586.358763:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213778001771 time 7213779262748 state 0x2 ref 0 00010000:00010000:3.0:1782487586.358780:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xb4c:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.358785:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.358789:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358795:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dc17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xb4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.358807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.358814:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.358818:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.358821:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487586.358828:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294385664 00000100:00100000:1.0:1782487586.358832:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294385664 00000100:00100000:3.0:1782487586.358881:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16254 00000100:00100000:3.0:1782487586.358892:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2362:x1869066294385664:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.358902:0:213228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.358907:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358917:0:213228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782d1 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.358917:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.358934:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.358941:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.358944:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487586.358949:0:213228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x187f:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.358950:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.358964:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.358967:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.358968:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.358970:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358974:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.358981:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dbed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.358988:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 133 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.359004:0:213228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 133 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.359016:0:213228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7c00, rc 0) 00000100:00100000:3.0:1782487586.359044:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+133:2362:x1869066294385664:12345-192.168.202.21@tcp:101:rm.500 Request processed in 154us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.359052:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16254 00000100:00100000:3.0:1782487586.359439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.359471:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294385920 00000100:00100000:2.0:1782487586.359476:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294385920 00000100:00100000:2.0:1782487586.359491:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213778001771 time 7213779262748 state 0x0 ref 1 00000100:00100000:2.0:1782487586.359499:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213779362748 time 7213779262748 state 0x1 ref 1 00000100:00100000:2.0:1782487586.359523:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213779362748 time 7213780913791 state 0x0 ref 1 00000100:00100000:2.0:1782487586.359532:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1176:294605:x1869066294385920:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.359557:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.359569:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85dbf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ca expref: 1176 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.359580:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.359589:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.359655:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.359665:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.359673:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.359743:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b220c85a reply state 000000002c75f640 transno 8589956990 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.359752:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.359793:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1177:294605:x1869066294385920:12345-192.168.202.21@tcp:36:touch.500 Request processed in 261us (356us total) trans 8589956990 rc 0/0 00000100:00100000:2.0:1782487586.359800:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27155 00000100:00100000:2.0:1782487586.359804:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213779362748 time 7213780913791 state 0x2 ref 0 00000100:00100000:3.0:1782487586.359831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.360812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.361672:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361682:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361689:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361695:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.361700:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361707:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361718:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487586.361721:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.361725:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361736:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85dc25 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.361764:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294386176 00000100:00100000:2.0:1782487586.361769:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294386176 00000100:00100000:2.0:1782487586.361789:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213779362748 time 7213780913791 state 0x0 ref 1 00000100:00100000:2.0:1782487586.361799:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213781013791 time 7213780913791 state 0x1 ref 1 00000100:00100000:2.0:1782487586.361818:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294386304 00000100:00100000:2.0:1782487586.361820:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294386304 00000100:00100000:2.0:1782487586.361830:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213781013791 time 7213780913791 state 0x1 ref 2 00000100:00100000:3.0:1782487586.361841:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213783330129 time 7213783230129 state 0x1 ref 2 00000100:00100000:2.0:1782487586.361850:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213783330129 time 7213783239633 state 0x0 ref 2 00000100:00100000:3.0:1782487586.361856:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1177:294608:x1869066294386176:12345-192.168.202.21@tcp:101:touch.500 00000100:00100000:2.0:1782487586.361865:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1177:294605:x1869066294386304:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.361871:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.361875:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.361884:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc2c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782d8 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361890:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dc33 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782df expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361926:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dc33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782df expref: 1179 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361948:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dc33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782df expref: 1179 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.361964:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.361967:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.361970:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548fb5200, rc 0) 00010000:00010000:3.0:1782487586.361980:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.361990:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.361996:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.362010:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1179:294605:x1869066294386304:12345-192.168.202.21@tcp:101:touch.500 Request processed in 147us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.362018:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27157 00010000:00010000:3.0:1782487586.362073:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362079:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362084:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362098:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362110:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362115:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362120:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.362123:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362130:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362139:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.362142:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.362145:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.362150:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487586.362516:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185b:0x0], index 1: 0 00010000:00010000:3.0:1782487586.362695:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dc48 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362705:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dc48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362712:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dc48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362746:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362754:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362760:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362766:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.362770:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362777:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362787:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.362790:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.362795:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362801:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.362814:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bec845dd reply state 000000008c6411c5 transno 8589956991 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.362820:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.362840:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc2c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d8 expref: 1180 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362854:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dc48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d8 expref: 1179 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.362859:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb55880d900) 00010000:00010000:3.0:1782487586.362861:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.362863:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb000, rc 0) 00000100:00100000:3.0:1782487586.362901:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1180:294608:x1869066294386176:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1050us (3073us total) trans 8589956991 rc 0/0 00000100:00100000:3.0:1782487586.362907:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27156 00000100:00100000:3.0:1782487586.362912:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213783330129 time 7213783239633 state 0x2 ref 0 00010000:00010000:1.0:1782487586.363695:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363705:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363712:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363718:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.363722:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363729:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363739:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb56d889800) 00010000:00010000:1.0:1782487586.363742:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.363745:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.363752:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc41 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.364064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.364220:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294386432 00000100:00100000:3.0:1782487586.364228:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294386432 00000100:00100000:3.0:1782487586.364281:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16255 00000100:00100000:3.0:1782487586.364291:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+133:2360:x1869066294386432:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.364571:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2360:x1869066294386432:12345-192.168.202.21@tcp:2:touch.500 Request processed in 282us (507us total) trans 8589940684 rc 0/0 00000100:00100000:3.0:1782487586.364578:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16255 00000100:00100000:2.0:1782487586.365504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.365526:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294386688 00000100:00100000:2.0:1782487586.365529:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294386688 00000100:00100000:2.0:1782487586.365557:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5797 00000100:00100000:2.0:1782487586.365566:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1179:294605:x1869066294386688:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.365814:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1180:294605:x1869066294386688:12345-192.168.202.21@tcp:35:touch.500 Request processed in 249us (311us total) trans 8589956992 rc 0/0 00000100:00100000:2.0:1782487586.365822:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5797 00000100:00100000:2.0:1782487586.367420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.367491:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387200 00000100:00100000:1.0:1782487586.367497:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387200 00000100:00100000:1.0:1782487586.367520:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213783330129 time 7213783239633 state 0x0 ref 1 00000100:00100000:1.0:1782487586.367531:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213783339633 time 7213783239633 state 0x1 ref 1 00000100:00100000:2.0:1782487586.367642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.368550:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387072 00000100:00100000:1.0:1782487586.368554:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387072 00000100:00100000:1.0:1782487586.368571:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213783339633 time 7213783239633 state 0x1 ref 2 00000100:00100000:1.0:1782487586.368590:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790080650 time 7213789980650 state 0x1 ref 2 00000100:00100000:1.0:1782487586.368600:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1181:294608:x1869066294387200:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.368685:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.368708:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85dc48 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d8 expref: 1181 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.368729:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb55880d900) 00010000:00010000:1.0:1782487586.368741:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.368776:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790080650 time 7213790164109 state 0x0 ref 2 00000100:00100000:3.0:1782487586.368794:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1180:294609:x1869066294387072:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.368797:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368805:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.368811:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368819:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dc5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782e6 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.368821:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.368930:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012aa0a86 reply state 00000000b1b807e4 transno 8589956993 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368945:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368956:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368964:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368977:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368984:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.368992:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.369017:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.369118:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:294608:x1869066294387200:12345-192.168.202.21@tcp:36:touch.500 Request processed in 518us (1700us total) trans 8589956993 rc 0/0 00000100:00100000:1.0:1782487586.369125:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27158 00000004:00080000:3.0:1782487586.369794:0:190296:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1882:0x0], index 0: 0 00010000:00010000:3.0:1782487586.369956:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc72 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.369967:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.369977:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370007:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370020:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370027:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370034:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.370039:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370047:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370058:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.370061:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.370065:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370072:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dc64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.370083:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001dae8a3b reply state 00000000ba6e0d7f transno 8589956994 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.370090:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.370113:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85dc5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782e6 expref: 1184 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370128:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782e6 expref: 1183 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.370142:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:3.0:1782487586.370145:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.370148:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7a00, rc 0) 00000100:00100000:3.0:1782487586.370194:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1184:294609:x1869066294387072:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1404us (2551us total) trans 8589956994 rc 0/0 00000100:00100000:3.0:1782487586.370214:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27159 00000100:00100000:3.0:1782487586.370220:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790080650 time 7213790164109 state 0x2 ref 0 00010000:00010000:3.0:1782487586.373018:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373034:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373042:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373049:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.373055:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373063:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373079:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7300) 00010000:00010000:3.0:1782487586.373082:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.373086:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.373098:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85dc56 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.373687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.373747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.373814:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373824:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373831:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373836:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.373839:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373847:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373857:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb55880d800) 00010000:00010000:1.0:1782487586.373860:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.373863:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.373869:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dc6b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.373898:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387328 00000100:00100000:1.0:1782487586.373905:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387328 00000100:00100000:1.0:1782487586.373930:0:196437:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790080650 time 7213790164109 state 0x0 ref 1 00000100:00100000:1.0:1782487586.373953:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790264109 time 7213790164109 state 0x1 ref 1 00000100:00100000:1.0:1782487586.373970:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387584 00000100:00100000:1.0:1782487586.373973:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387584 00000100:00100000:1.0:1782487586.373983:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213790264109 time 7213790164109 state 0x1 ref 2 00000100:00100000:1.0:1782487586.374003:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795492677 time 7213795392677 state 0x1 ref 2 00000100:00100000:1.0:1782487586.374012:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:294608:x1869066294387328:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.374029:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782487586.374031:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213795492677 time 7213795419708 state 0x0 ref 2 00010000:00010000:1.0:1782487586.374044:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc80 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782ed expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.374051:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1183:294611:x1869066294387584:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.374066:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.374079:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dc87 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782f4 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374095:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ed expref: 1184 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374107:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ed expref: 1184 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374123:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:1.0:1782487586.374126:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782487586.374128:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7e00, rc 0) 00000100:00100000:1.0:1782487586.374182:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1185:294608:x1869066294387328:12345-192.168.202.21@tcp:101:touch.500 Request processed in 170us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.374189:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27160 00000100:00100000:1.0:1782487586.374236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.374280:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.374292:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.374301:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.374309:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387840 00000100:00100000:1.0:1782487586.374314:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387840 00010000:00010000:3.0:1782487586.374316:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.374324:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.374329:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213795519708 time 7213795419708 state 0x1 ref 2 00010000:00010000:3.0:1782487586.374335:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.374346:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795519708 time 7213795736140 state 0x0 ref 2 00000100:00100000:1.0:1782487586.374356:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1185:294609:x1869066294387840:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.374378:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.374391:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dc72 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782e6 expref: 1185 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374402:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:1.0:1782487586.374409:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.374455:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374468:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.374476:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.374581:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f494840c reply state 00000000a44f5a40 transno 8589956995 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.374590:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.374666:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1186:294609:x1869066294387840:12345-192.168.202.21@tcp:36:touch.500 Request processed in 311us (429us total) trans 8589956995 rc 0/0 00000100:00100000:1.0:1782487586.374673:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27162 00000004:00080000:3.0:1782487586.375278:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185c:0x0], index 1: 0 00010000:00010000:3.0:1782487586.375505:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dca3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375565:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dca3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375575:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dca3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375630:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375639:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375646:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375653:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548fb4800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.375657:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375665:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375676:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.375679:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.375683:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375689:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85dc8e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.375704:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001580ee28 reply state 0000000074deacc4 transno 8589956996 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.375711:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.375736:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dc87 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782f4 expref: 1187 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375752:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dca3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782f4 expref: 1186 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.375760:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880d300) 00010000:00010000:3.0:1782487586.375764:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.375767:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7e00, rc 0) 00000100:00100000:3.0:1782487586.375807:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4d2219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1187:294611:x1869066294387584:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1763us (2059us total) trans 8589956996 rc 0/0 00000100:00100000:3.0:1782487586.375815:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27161 00000100:00100000:3.0:1782487586.375820:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795519708 time 7213795736140 state 0x2 ref 0 00000100:00100000:1.0:1782487586.377008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.377083:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294387968 00000100:00100000:2.0:1782487586.377089:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294387968 00000100:00100000:2.0:1782487586.377133:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16256 00000100:00100000:2.0:1782487586.377141:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2361:x1869066294387968:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.377392:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2361:x1869066294387968:12345-192.168.202.21@tcp:2:touch.500 Request processed in 250us (386us total) trans 8589940021 rc 0/0 00000100:00100000:2.0:1782487586.377399:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16256 00010000:00010000:3.0:1782487586.377824:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377834:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377841:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377847:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.377852:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377859:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377871:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.377874:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.377877:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.377884:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dc9c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.377991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487586.378041:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378049:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378055:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378060:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.378062:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378069:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378078:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb55880db00) 00010000:00010000:1.0:1782487586.378081:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.378084:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378091:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85dc95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.378138:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294388096 00000100:00100000:3.0:1782487586.378142:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294388096 00000100:00100000:3.0:1782487586.378161:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795519708 time 7213795736140 state 0x0 ref 1 00000100:00100000:3.0:1782487586.378179:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795836140 time 7213795736140 state 0x1 ref 1 00000100:00100000:3.0:1782487586.378207:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795836140 time 7213799589848 state 0x0 ref 1 00000100:00100000:3.0:1782487586.378217:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1185:294609:x1869066294388096:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.378229:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.378244:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85dcb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4782fb expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378281:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85dcb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782fb expref: 1186 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378292:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85dcb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782fb expref: 1186 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378307:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:3.0:1782487586.378310:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.378312:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54834c800, rc 0) 00000100:00100000:3.0:1782487586.378445:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1186:294609:x1869066294388096:12345-192.168.202.21@tcp:101:touch.500 Request processed in 227us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.378453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.378459:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27163 00000100:00100000:3.0:1782487586.378465:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795836140 time 7213799589848 state 0x2 ref 0 00000100:00100000:3.0:1782487586.378488:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294388480 00000100:00100000:3.0:1782487586.378492:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294388480 00000100:00100000:2.0:1782487586.378525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.378566:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213795836140 time 7213799589848 state 0x0 ref 1 00000100:00100000:1.0:1782487586.378571:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294388608 00000100:00100000:3.0:1782487586.378576:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213799689848 time 7213799589848 state 0x1 ref 1 00000100:00100000:1.0:1782487586.378577:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294388608 00000100:00100000:3.0:1782487586.378596:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213799689848 time 7213799986855 state 0x0 ref 2 00000100:00100000:3.0:1782487586.378631:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4d221a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1187:294611:x1869066294388480:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1782487586.378667:0:190296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487586.378670:0:196437:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800086855 time 7213799986855 state 0x1 ref 2 00010000:00010000:3.0:1782487586.378684:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dca3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782f4 expref: 1187 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378697:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880d300) 00010000:00010000:3.0:1782487586.378704:0:190296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.378723:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800086855 time 7213800112883 state 0x0 ref 2 00000100:00100000:1.0:1782487586.378735:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1186:294613:x1869066294388608:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:1.0:1782487586.378744:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.378748:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378755:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dcbf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478302 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378759:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.378773:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378847:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378857:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378866:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378877:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.378880:0:190296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a82e4a7 reply state 00000000a96ce764 transno 8589956997 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.378887:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.378892:0:190296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.378898:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.378950:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4d221a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1189:294611:x1869066294388480:12345-192.168.202.21@tcp:36:touch.500 Request processed in 344us (500us total) trans 8589956997 rc 0/0 00000100:00100000:3.0:1782487586.378959:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27164 00000004:00080000:1.0:1782487586.379317:0:196437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1883:0x0], index 0: 0 00010000:00010000:1.0:1782487586.379426:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85dcd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379441:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85dcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379449:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85dcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379474:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379481:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379487:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379493:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.379496:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379502:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379514:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.379517:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.379520:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379526:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85dcc6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.379535:0:196437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000926294a4 reply state 000000002ba0d855 transno 8589956998 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.379542:0:196437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782487586.379560:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85dcbf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478302 expref: 1190 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379572:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85dcd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478302 expref: 1189 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.379579:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb5432e7300) 00010000:00010000:1.0:1782487586.379582:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.379584:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7000, rc 0) 00000100:00100000:1.0:1782487586.379627:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1190:294613:x1869066294388608:12345-192.168.202.21@tcp:101:touch.500 Request processed in 894us (1102us total) trans 8589956998 rc 0/0 00000100:00100000:1.0:1782487586.379639:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27165 00000100:00100000:1.0:1782487586.379643:0:196437:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800086855 time 7213800112883 state 0x2 ref 0 00000100:00100000:1.0:1782487586.379952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.379990:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294388864 00000100:00100000:3.0:1782487586.379996:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294388864 00000100:00100000:3.0:1782487586.380031:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5798 00000100:00100000:3.0:1782487586.380040:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1190:294608:x1869066294388864:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.380707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.380737:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1191:294608:x1869066294388864:12345-192.168.202.21@tcp:35:touch.500 Request processed in 697us (784us total) trans 8589956999 rc 0/0 00000100:00100000:3.0:1782487586.380746:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5798 00010000:00010000:3.0:1782487586.380773:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380781:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380788:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380794:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4afa00 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:1.0:1782487586.380799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.380801:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380810:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380822:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487586.380825:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.380829:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.380835:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85dcb8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.380853:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294388992 00000100:00100000:2.0:1782487586.380858:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294388992 00000100:00100000:3.0:1782487586.380866:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294389120 00000100:00100000:3.0:1782487586.380872:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294389120 00000100:00100000:3.0:1782487586.380889:0:213218:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800086855 time 7213800112883 state 0x0 ref 1 00000100:00100000:2.0:1782487586.380890:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16257 00000100:00100000:2.0:1782487586.380902:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2361:x1869066294388992:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.380903:0:213218:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800212883 time 7213800112883 state 0x1 ref 1 00000100:00100000:3.0:1782487586.380935:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800212883 time 7213802325299 state 0x0 ref 1 00000100:00100000:3.0:1782487586.380948:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1190:294611:x1869066294389120:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.380958:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.380971:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85dce2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478309 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.381000:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85dce2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478309 expref: 1191 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.381011:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85dce2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478309 expref: 1191 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.381032:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:3.0:1782487586.381035:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.381038:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afc00, rc 0) 00000100:00100000:3.0:1782487586.381069:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1191:294611:x1869066294389120:12345-192.168.202.21@tcp:101:touch.500 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.381079:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27166 00000100:00100000:2.0:1782487586.381080:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2361:x1869066294388992:12345-192.168.202.21@tcp:2:touch.500 Request processed in 177us (370us total) trans 8589940685 rc 0/0 00000100:00100000:3.0:1782487586.381086:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800212883 time 7213802325299 state 0x2 ref 0 00000100:00100000:2.0:1782487586.381093:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16257 00010000:00010000:1.0:1782487586.381404:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381413:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381419:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381425:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.381428:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381435:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381444:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.381446:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.381449:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.381456:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85dccd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.382008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.382048:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294389376 00000100:00100000:3.0:1782487586.382053:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294389376 00000100:00100000:3.0:1782487586.382225:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213800212883 time 7213802325299 state 0x0 ref 1 00000100:00100000:3.0:1782487586.382235:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213802425299 time 7213802325299 state 0x1 ref 1 00000100:00100000:1.0:1782487586.382253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.382268:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294389632 00000100:00100000:3.0:1782487586.382272:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294389632 00000100:00100000:3.0:1782487586.382288:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213802425299 time 7213802325299 state 0x1 ref 2 00000100:00100000:2.0:1782487586.382301:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213803789220 time 7213803689220 state 0x1 ref 2 00000100:00100000:3.0:1782487586.382311:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213803789220 time 7213803700801 state 0x0 ref 2 00000100:00100000:2.0:1782487586.382316:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1191:294613:x1869066294389376:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:3.0:1782487586.382328:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1191:294616:x1869066294389632:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.382340:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.382348:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.382352:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85dce9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478310 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.382363:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85dcd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478302 expref: 1192 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.382376:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb5432e7300) 00010000:00010000:2.0:1782487586.382383:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.382422:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.382431:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.382440:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.382457:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.382472:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.382481:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.382496:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.382504:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.382514:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040bce124 reply state 00000000309581cb transno 8589957000 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.382527:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.382575:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1193:294613:x1869066294389376:12345-192.168.202.21@tcp:36:touch.500 Request processed in 263us (567us total) trans 8589957000 rc 0/0 00000100:00100000:2.0:1782487586.382582:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27167 00010000:00010000:3.0:1782487586.382657:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.382717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.382752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.382879:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294389760 00000100:00100000:2.0:1782487586.382884:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294389760 00000100:00100000:2.0:1782487586.382913:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16258 00000100:00100000:2.0:1782487586.382920:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2360:x1869066294389760:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:2.0:1782487586.383101:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2360:x1869066294389760:12345-192.168.202.21@tcp:2:touch.500 Request processed in 181us (384us total) trans 8589940022 rc 0/0 00000100:00100000:2.0:1782487586.383110:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16258 00000100:00100000:2.0:1782487586.383130:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294390016 00000100:00100000:2.0:1782487586.383133:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294390016 00000004:00080000:3.0:1782487586.383153:0:213935:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185d:0x0], index 1: 0 00000100:00100000:2.0:1782487586.383155:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5799 00000100:00100000:2.0:1782487586.383164:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560bc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1193:294609:x1869066294390016:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.383328:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560bc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1195:294609:x1869066294390016:12345-192.168.202.21@tcp:35:touch.500 Request processed in 164us (575us total) trans 8589957001 rc 0/0 00000100:00100000:2.0:1782487586.383336:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5799 00010000:00010000:3.0:1782487586.383385:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dd05 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.383396:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dd05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.383405:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dd05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.383433:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.383441:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.383447:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.384082:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.384087:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.384095:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.384107:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.384111:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.384114:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.384121:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85dcf7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.384134:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ee17ee6 reply state 00000000db8a04df transno 8589957002 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.384140:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.384828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.384868:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85dce9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478310 expref: 1195 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.384883:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dd05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478310 expref: 1194 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.384898:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d900) 00010000:00010000:2.0:1782487586.384901:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.384903:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4cbdc7600, rc 0) 00000100:00100000:2.0:1782487586.384934:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1195:294616:x1869066294389632:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2612us (2683us total) trans 8589957002 rc 0/0 00000100:00100000:2.0:1782487586.384942:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27168 00000100:00100000:2.0:1782487586.384948:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213803789220 time 7213803700801 state 0x2 ref 0 00000100:00100000:2.0:1782487586.384968:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294390144 00000100:00100000:2.0:1782487586.384971:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294390144 00000100:00100000:2.0:1782487586.384986:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213803789220 time 7213803700801 state 0x0 ref 1 00000100:00100000:2.0:1782487586.384995:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213803800801 time 7213803700801 state 0x1 ref 1 00000100:00100000:2.0:1782487586.385008:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213803800801 time 7213806398601 state 0x0 ref 1 00000100:00100000:2.0:1782487586.385016:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1195:294613:x1869066294390144:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.385028:0:213935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.385040:0:213935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85dd13 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478317 expref: -99 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.385070:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85dd13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478317 expref: 1196 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.385080:0:213935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb455050600/0x66475b4e8b85dd13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478317 expref: 1196 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.385100:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.385103:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.385105:0:213935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb455050600, rc 0) 00000100:00100000:2.0:1782487586.385120:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1196:294613:x1869066294390144:12345-192.168.202.21@tcp:101:touch.500 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.385126:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27169 00000100:00100000:2.0:1782487586.385130:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213803800801 time 7213806398601 state 0x2 ref 0 00010000:00010000:3.0:1782487586.385700:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385711:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385718:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385724:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.385728:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385735:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385748:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.385751:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.385755:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.385761:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85dcf0 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.386292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.386384:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294390400 00000100:00100000:3.0:1782487586.386390:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294390400 00000100:00100000:3.0:1782487586.386434:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5800 00000100:00100000:3.0:1782487586.386444:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1195:294611:x1869066294390400:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1782487586.386734:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44b4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1196:294611:x1869066294390400:12345-192.168.202.21@tcp:35:touch.500 Request processed in 291us (442us total) trans 8589957003 rc 0/0 00000100:00100000:3.0:1782487586.386743:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5800 00000100:00100000:1.0:1782487586.387456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.387589:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.387684:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294390656 00000100:00100000:3.0:1782487586.387688:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294390656 00000100:00100000:3.0:1782487586.387709:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213803800801 time 7213806398601 state 0x0 ref 1 00000100:00100000:3.0:1782487586.387720:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213806498601 time 7213806398601 state 0x1 ref 1 00010000:00010000:2.0:1782487586.387731:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387742:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.387745:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294390912 00000100:00100000:3.0:1782487586.387750:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294390912 00010000:00010000:2.0:1782487586.387752:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387759:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.387763:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.387766:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213806498601 time 7213806398601 state 0x1 ref 2 00010000:00010000:2.0:1782487586.387776:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387789:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb55880d800) 00010000:00010000:2.0:1782487586.387792:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782487586.387794:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213809284170 time 7213809184170 state 0x1 ref 2 00010000:00010000:2.0:1782487586.387797:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387807:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85dcfe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.387811:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1197:294616:x1869066294390656:12345-192.168.202.21@tcp:36:touch.500 00000100:00100000:2.0:1782487586.387843:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809284170 time 7213809232552 state 0x0 ref 2 00010000:00010000:3.0:1782487586.387846:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487586.387860:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1196:294615:x1869066294390912:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.387867:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85dd05 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478310 expref: 1196 pid: 213935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387870:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.387882:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85dd1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47831e expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.387884:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d900) 00010000:00010000:3.0:1782487586.387897:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.387955:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.387967:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.387977:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387983:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.387994:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388002:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388016:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388022:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388029:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.388072:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085c1a5fb reply state 00000000eb98dfb1 transno 8589957004 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.388081:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.388144:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1198:294616:x1869066294390656:12345-192.168.202.21@tcp:36:touch.500 Request processed in 334us (686us total) trans 8589957004 rc 0/0 00000100:00100000:3.0:1782487586.388154:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27170 00000004:00080000:2.0:1782487586.388755:0:190299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1884:0x0], index 0: 0 00010000:00010000:2.0:1782487586.388870:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85dd36 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388879:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85dd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388888:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85dd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388912:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388919:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388925:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388931:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.388934:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388940:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388948:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.388950:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.388953:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.388959:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85dd28 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.388974:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4444df4 reply state 00000000708ef729 transno 8589957005 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.388981:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.388999:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85dd1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47831e expref: 1199 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.389011:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85dd36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47831e expref: 1198 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.389018:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.389021:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.389023:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44fb74a00, rc 0) 00000100:00100000:2.0:1782487586.389054:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1199:294615:x1869066294390912:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1199us (1466us total) trans 8589957005 rc 0/0 00000100:00100000:2.0:1782487586.389061:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27171 00000100:00100000:2.0:1782487586.389066:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809284170 time 7213809232552 state 0x2 ref 0 00000100:00100000:1.0:1782487586.390689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.390719:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391040 00000100:00100000:3.0:1782487586.390726:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391040 00000100:00100000:3.0:1782487586.390766:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16259 00000100:00100000:3.0:1782487586.390777:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2360:x1869066294391040:12345-192.168.202.21@tcp:2:touch.500 00010000:00010000:2.0:1782487586.390830:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390841:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390847:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390852:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.390857:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390863:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390874:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb4c5187900) 00010000:00010000:2.0:1782487586.390876:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.390880:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390886:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85dd2f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390909:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390916:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390922:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390927:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.390929:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390935:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390942:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d300) 00010000:00010000:2.0:1782487586.390944:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.390947:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.390953:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85dd21 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.391017:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2360:x1869066294391040:12345-192.168.202.21@tcp:2:touch.500 Request processed in 241us (331us total) trans 8589940686 rc 0/0 00000100:00100000:3.0:1782487586.391027:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16259 00000100:00100000:1.0:1782487586.395948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.395993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.395993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.396040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.396065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.396096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.396126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.396157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396176:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391168 00000100:00100000:3.0:1782487586.396183:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391168 00000100:00100000:1.0:1782487586.396191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396226:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809284170 time 7213809232552 state 0x0 ref 1 00000100:00100000:1.0:1782487586.396238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.396240:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 1 00000100:00100000:1.0:1782487586.396255:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391552 00000100:00100000:3.0:1782487586.396259:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391424 00000100:00100000:1.0:1782487586.396260:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391552 00000100:00100000:3.0:1782487586.396264:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391424 00000100:00100000:1.0:1782487586.396279:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 2 00000100:00100000:3.0:1782487586.396290:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 3 00000100:00100000:1.0:1782487586.396291:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391680 00000100:00100000:1.0:1782487586.396296:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391680 00000100:00100000:3.0:1782487586.396308:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391808 00000100:00100000:1.0:1782487586.396313:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 4 00000100:00100000:3.0:1782487586.396314:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391808 00000100:00100000:1.0:1782487586.396326:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294391936 00000100:00100000:1.0:1782487586.396329:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294391936 00000100:00100000:3.0:1782487586.396335:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 5 00000100:00100000:1.0:1782487586.396344:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 6 00000100:00100000:3.0:1782487586.396349:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392064 00000100:00100000:3.0:1782487586.396353:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392064 00000100:00100000:1.0:1782487586.396355:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392832 00000100:00100000:1.0:1782487586.396359:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392832 00000100:00100000:3.0:1782487586.396371:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213809332552 time 7213809232552 state 0x1 ref 7 00000100:00100000:2.0:1782487586.396413:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392192 00000100:00100000:2.0:1782487586.396417:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392192 00000100:00100000:2.0:1782487586.396434:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392576 00000100:00100000:2.0:1782487586.396437:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392576 00000100:00100000:2.0:1782487586.396445:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392704 00000100:00100000:2.0:1782487586.396447:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392704 00000100:00100000:2.0:1782487586.396456:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392960 00000100:00100000:2.0:1782487586.396458:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392960 00000100:00100000:2.0:1782487586.396466:0:190303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393088 00000100:00100000:2.0:1782487586.396468:0:190303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393088 00000100:00100000:2.0:1782487586.396479:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1159 00000100:00100000:2.0:1782487586.396486:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1209:2361:x1869066294392192:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487586.396531:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.396676:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85dd44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478372 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396730:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396744:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396837:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396855:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396864:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396871:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396975:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396984:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.396991:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.397007:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb0f:0x0]: returning size 0 00000004:00200000:2.0:1782487586.397011:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.397026:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397036:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397045:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397052:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397059:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397069:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd88c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397074:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397080:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397091:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.397094:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397097:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397103:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88c00/0x66475b4e8b85dd4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397115:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397122:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397128:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397133:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd89400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397136:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397141:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397152:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb4664e1700) 00010000:00010000:2.0:1782487586.397154:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397157:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397163:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89400/0x66475b4e8b85dd52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397206:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd89e00/0x66475b4e8b85dd44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478372 expref: 1211 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397218:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478372 expref: 1210 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397226:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:2.0:1782487586.397229:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.397231:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57fd88200, rc 0) 00010000:00010000:2.0:1782487586.397235:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.397244:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85dd60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478387 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397264:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397272:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397279:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397294:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397301:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397307:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397349:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397357:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397364:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.397375:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb10:0x0]: returning size 0 00000004:00200000:2.0:1782487586.397377:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.397385:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397393:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397401:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397407:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397418:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397423:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397426:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397431:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397438:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.397440:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397443:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397448:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c800/0x66475b4e8b85dd67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397457:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397463:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397469:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397474:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb548f4ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397477:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397487:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397494:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb4664e1600) 00010000:00010000:2.0:1782487586.397496:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397498:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397503:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4ce00/0x66475b4e8b85dd6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397519:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb467570a00/0x66475b4e8b85dd60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478387 expref: 1212 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397529:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478387 expref: 1211 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397535:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487586.397537:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.397539:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb548f4c200, rc 0) 00010000:00010000:2.0:1782487586.397542:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.397548:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85dd7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478395 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397568:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397576:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397584:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397596:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397603:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397634:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397694:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397702:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397709:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.397724:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb11:0x0]: returning size 0 00000004:00200000:2.0:1782487586.397726:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.397735:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397743:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397750:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397761:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397767:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397772:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cdb55800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397775:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397781:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397788:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.397790:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397793:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397800:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cdb55800/0x66475b4e8b85dd83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397809:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397814:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397820:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397826:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb48b447400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.397829:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397835:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397841:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb543a0d200) 00010000:00010000:2.0:1782487586.397844:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.397846:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397852:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb48b447400/0x66475b4e8b85dd8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397869:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4da00/0x66475b4e8b85dd7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478395 expref: 1213 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397878:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478395 expref: 1212 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397885:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.397887:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.397889:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454f51c00, rc 0) 00010000:00010000:2.0:1782487586.397892:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.397899:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85dd98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783a3 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397916:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397923:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397931:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.397941:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.397985:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213819474884 time 7213819374884 state 0x1 ref 8 00000100:00100000:3.0:1782487586.397999:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1213:294616:x1869066294391168:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:3.0:1782487586.398008:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.398023:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ddad lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478325 expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398042:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.398053:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ddad lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478325 expref: 1214 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398053:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398106:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398115:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398122:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.398132:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0ce00/0x66475b4e8b85ddad lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478325 expref: 1214 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.398135:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb13:0x0]: returning size 0 00000004:00200000:2.0:1782487586.398138:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.398147:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398157:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.398165:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:3.0:1782487586.398170:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782487586.398173:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb454b0ce00, rc 0) 00010000:00010000:2.0:1782487586.398174:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398187:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398193:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398198:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.398209:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398215:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398222:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.398224:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.398228:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398234:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25600/0x66475b4e8b85dd9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398244:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.398245:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1214:294616:x1869066294391168:12345-192.168.202.21@tcp:101:touch.500 Request processed in 246us (2301us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.398259:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398265:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398348:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb56da25000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.398353:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398360:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398368:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb543a0d800) 00010000:00010000:2.0:1782487586.398371:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.398374:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398379:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25000/0x66475b4e8b85dda6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398399:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb56da25200/0x66475b4e8b85dd98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783a3 expref: 1215 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398409:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783a3 expref: 1214 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398415:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:2.0:1782487586.398422:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.398424:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb57976e800, rc 0) 00010000:00010000:2.0:1782487586.398428:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.398435:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85ddbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783b1 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398457:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398465:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398473:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398484:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398491:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398497:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398540:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398548:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398554:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.398567:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00000004:00200000:2.0:1782487586.398570:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.398578:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398587:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398594:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398603:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398625:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398631:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45653da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.398634:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398640:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398647:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.398650:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.398653:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398713:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653da00/0x66475b4e8b85ddc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398724:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398730:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398736:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398742:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4715acc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.398745:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398752:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398760:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb543a0d600) 00010000:00010000:2.0:1782487586.398762:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.398765:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398771:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4715acc00/0x66475b4e8b85ddc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398790:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb45653dc00/0x66475b4e8b85ddbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b1 expref: 1216 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398801:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b1 expref: 1215 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398808:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:2.0:1782487586.398810:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.398813:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb547117200, rc 0) 00010000:00010000:2.0:1782487586.398817:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.398824:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85ddd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783bf expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398843:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398851:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398858:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398868:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398874:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398881:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398923:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398931:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398937:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.398949:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00000004:00200000:2.0:1782487586.398951:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.398959:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398966:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398973:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398983:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398990:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.398995:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.398998:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399004:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399011:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.399013:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.399016:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399021:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad6a00/0x66475b4e8b85ddde lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399030:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399037:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399043:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399048:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb451ad7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.399051:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399057:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399063:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb543a0d300) 00010000:00010000:2.0:1782487586.399065:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.399068:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399073:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb451ad7600/0x66475b4e8b85dde5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399089:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5457d9000/0x66475b4e8b85ddd7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783bf expref: 1217 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399098:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783bf expref: 1216 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399104:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.399106:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.399108:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb551446000, rc 0) 00010000:00010000:2.0:1782487586.399111:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.399117:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ddf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783cd expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399134:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399142:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399149:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399161:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399232:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399241:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399286:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399294:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399302:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.399314:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.399321:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399328:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399335:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399341:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399348:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399354:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551447c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.399357:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399363:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399370:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.399372:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.399375:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399381:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447c00/0x66475b4e8b85ddfa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399390:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399395:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399401:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399406:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.399409:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399419:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399426:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb543a0d700) 00010000:00010000:2.0:1782487586.399428:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.399430:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399436:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07000/0x66475b4e8b85de01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399452:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551447e00/0x66475b4e8b85ddf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 1218 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399461:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd06a00/0x66475b4e8b85de08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783cd expref: 1217 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399468:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.399470:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.399472:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb46fd06a00, rc 0) 00010000:00010000:2.0:1782487586.399475:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.399481:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85de0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783db expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399499:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399506:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399514:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399524:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399531:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399537:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399579:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399588:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.399595:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.399762:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213819474884 time 7213819374884 state 0x1 ref 8 00000100:00100000:3.0:1782487586.399773:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27172 00000100:00100000:1.0:1782487586.399784:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213821273789 time 7213821173789 state 0x1 ref 7 00000100:00100000:3.0:1782487586.399798:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213821288052 time 7213821188052 state 0x1 ref 7 00000100:00100000:1.0:1782487586.399799:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1217:294624:x1869066294391552:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:3.0:1782487586.399813:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1217:294615:x1869066294391424:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:1.0:1782487586.399814:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.399825:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85de2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47832c expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399849:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.399854:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399863:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399867:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74a00/0x66475b4e8b85dd36 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47831e expref: 1218 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399874:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399890:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399894:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.399898:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399900:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.399907:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399951:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399958:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399960:0:190298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 2/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399975:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399977:0:190298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 4/0,1 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.399992:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.399998:0:190298:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400006:0:190298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.400008:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb13:0x0]: returning size 0 00000004:00200000:1.0:1782487586.400014:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.400024:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.400034:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213821522830 time 7213821422830 state 0x1 ref 7 00010000:00010000:1.0:1782487586.400037:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.400045:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1217:294618:x1869066294391680:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.400046:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400053:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.400055:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400061:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400063:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85de4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47835d expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400069:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.400072:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400078:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400086:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.400088:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.400091:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400097:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6000/0x66475b4e8b85de32 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400108:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400116:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400125:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400130:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.400132:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400138:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400145:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb5432e7600) 00010000:00010000:1.0:1782487586.400147:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.400149:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400154:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6400/0x66475b4e8b85de39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400215:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400224:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400230:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.400237:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1160 00010000:00010000:3.0:1782487586.400240:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400246:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.400248:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:2363:x1869066294392576:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487586.400258:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400285:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.400296:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85de63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478380 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400321:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400323:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400337:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400344:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400347:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400360:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.400369:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb0e:0x0]: returning size 0 00000004:00200000:3.0:1782487586.400372:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.400373:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.400381:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400381:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400397:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400397:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400413:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400417:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400422:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400426:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.400428:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400437:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400447:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.400449:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.400452:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400454:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400463:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400467:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7a00/0x66475b4e8b85de55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400473:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.400491:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb10:0x0]: returning size 0 00010000:00010000:3.0:1782487586.400493:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.400494:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.400503:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.400506:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400510:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400517:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400519:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c4af600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.400526:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400539:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400540:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400556:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400559:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb55880d800) 00010000:00010000:3.0:1782487586.400565:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.400568:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400569:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400584:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a35eda00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.400585:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4af600/0x66475b4e8b85de5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400590:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400598:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400622:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.400625:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.400628:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400637:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc6a00/0x66475b4e8b85de4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47835d expref: 1221 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.400637:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a35eda00/0x66475b4e8b85de71 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400664:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47835d expref: 1220 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400672:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:3.0:1782487586.400675:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.400678:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb54c4afa00, rc 0) 00000100:00100000:3.0:1782487586.400710:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294618:x1869066294391680:12345-192.168.202.21@tcp:101:rm.500 Request processed in 668us (4646us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.400716:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27175 00000100:00100000:3.0:1782487586.400736:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213822226688 time 7213822126688 state 0x1 ref 6 00010000:00010000:1.0:1782487586.400740:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6600/0x66475b4e8b85de2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47832c expref: 1219 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.400750:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294623:x1869066294391808:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.400757:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47832c expref: 1218 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400759:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.400766:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:1.0:1782487586.400769:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.400771:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85de86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47836b expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400772:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c6c00, rc 0) 00000100:00100000:1.0:1782487586.400795:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294624:x1869066294391552:12345-192.168.202.21@tcp:101:rm.500 Request processed in 1002us (4806us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.400802:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.400808:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27173 00010000:00010000:3.0:1782487586.400813:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400823:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.400832:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213822321263 time 7213822221263 state 0x1 ref 5 00010000:00010000:3.0:1782487586.400833:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400848:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.400851:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1218:294619:x1869066294391936:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.400864:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400864:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.400873:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85de9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478379 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400900:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400908:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400917:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400930:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400931:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400949:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400950:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.400965:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.400967:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.400993:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00000004:00200000:3.0:1782487586.400997:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487586.401011:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401022:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401023:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401038:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401040:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401057:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401060:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.401075:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb0f:0x0]: returning size 0 00000004:00200000:1.0:1782487586.401078:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.401085:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.401087:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401090:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.401098:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401101:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401112:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401129:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401136:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401143:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401149:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.401153:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401159:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401226:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb451f41500) 00010000:00010000:2.0:1782487586.401233:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.401239:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.401245:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1a00/0x66475b4e8b85de78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401283:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401289:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401293:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401295:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.401301:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401310:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401311:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.401318:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.401322:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401328:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.401330:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30c00/0x66475b4e8b85de8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401331:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.401336:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401349:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7200/0x66475b4e8b85dea2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401350:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401364:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401367:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401371:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401377:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401382:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb579f30600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.401386:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401388:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401397:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.401405:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401405:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401420:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401427:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb55880db00) 00010000:00010000:1.0:1782487586.401429:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb5432e7300) 00010000:00010000:3.0:1782487586.401432:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.401433:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.401440:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401440:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401458:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6a00/0x66475b4e8b85deb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401459:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30600/0x66475b4e8b85de94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401486:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7000/0x66475b4e8b85de9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478379 expref: 1221 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401502:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4683ca600/0x66475b4e8b85de86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47836b expref: 1221 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401506:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478379 expref: 1221 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401520:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:1.0:1782487586.401523:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.401525:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c6200, rc 0) 00010000:00010000:3.0:1782487586.401529:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47836b expref: 1220 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401538:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:3.0:1782487586.401540:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.401543:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb579f30400, rc 0) 00000100:00100000:1.0:1782487586.401549:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294619:x1869066294391936:12345-192.168.202.21@tcp:101:rm.500 Request processed in 700us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.401556:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27177 00000100:00100000:3.0:1782487586.401568:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294623:x1869066294391808:12345-192.168.202.21@tcp:101:rm.500 Request processed in 820us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.401575:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213823065150 time 7213822965150 state 0x1 ref 4 00000100:00100000:3.0:1782487586.401585:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27176 00000100:00100000:1.0:1782487586.401590:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294620:x1869066294392064:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.401599:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.401624:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85debe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783e2 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.401640:0:196437:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213823065150 time 7213822996882 state 0x0 ref 3 00010000:00010000:1.0:1782487586.401652:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.401670:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294622:x1869066294392832:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.401671:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401686:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401689:0:196437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.401704:0:196437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85decc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478421 expref: -99 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401705:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401728:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401735:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401748:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401759:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401771:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401782:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401788:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401791:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401802:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401804:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401823:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.401828:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb10:0x0]: returning size 0 00000004:00200000:1.0:1782487586.401831:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.401841:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401849:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401856:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401862:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401869:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401878:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.401881:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401887:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401892:0:196437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401895:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.401900:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.401904:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401907:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401912:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6e00/0x66475b4e8b85dec5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401920:0:196437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401924:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401933:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401939:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.401942:0:196437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb11:0x0]: returning size 0 00010000:00010000:1.0:1782487586.401946:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc21ae4f0) 00000004:00200000:3.0:1782487586.401947:0:196437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.401950:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401957:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.401960:0:196437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401977:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb5432e7b00) 00010000:00010000:3.0:1782487586.401980:0:196437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401980:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.401985:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401989:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.401992:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7400/0x66475b4e8b85ded3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.401997:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402004:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402008:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7b400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.402011:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402017:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402017:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7a00/0x66475b4e8b85debe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e2 expref: 1221 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402036:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.402040:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.402040:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e2 expref: 1220 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402044:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402057:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7b400/0x66475b4e8b85deda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402058:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:1.0:1782487586.402064:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.402068:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4548c7c00, rc 0) 00010000:00010000:3.0:1782487586.402087:0:196437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.402087:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294620:x1869066294392064:12345-192.168.202.21@tcp:101:rm.500 Request processed in 502us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.402097:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27178 00010000:00010000:3.0:1782487586.402109:0:196437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402116:0:196437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402122:0:196437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fd7a000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.402126:0:196437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402134:0:196437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402151:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb579f0fd00) 00010000:00010000:3.0:1782487586.402154:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.402158:0:196437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402163:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd7a000/0x66475b4e8b85dee8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402175:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8dc00/0x66475b4e8b85de63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478380 expref: 1219 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402192:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478380 expref: 1219 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402195:0:196437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4800/0x66475b4e8b85decc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478421 expref: 1219 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402215:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487586.402219:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.402222:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4aabb1400, rc 0) 00010000:00010000:2.0:1782487586.402226:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.402229:0:196437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478421 expref: 1218 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402236:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85def6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47838e expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.402239:0:196437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:3.0:1782487586.402245:0:196437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.402250:0:196437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558498400, rc 0) 00010000:00010000:2.0:1782487586.402273:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402279:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1219:294622:x1869066294392832:12345-192.168.202.21@tcp:101:rm.500 Request processed in 627us (6040us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.402284:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402291:0:196437:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27179 00010000:00010000:2.0:1782487586.402295:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402309:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402315:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402322:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402363:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402372:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402378:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.402389:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb11:0x0]: returning size 0 00000004:00200000:2.0:1782487586.402391:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.402400:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402411:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402418:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402425:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402431:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402436:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb474400a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.402438:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402444:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402451:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.402453:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.402456:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402462:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474400a00/0x66475b4e8b85defd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402470:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402476:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402483:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402488:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44f587e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.402491:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402497:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402503:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb451f41600) 00010000:00010000:2.0:1782487586.402505:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.402508:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402513:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587e00/0x66475b4e8b85df04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402530:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb474401600/0x66475b4e8b85def6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47838e expref: 1219 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402539:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47838e expref: 1218 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402545:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.402547:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.402549:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb44f587c00, rc 0) 00010000:00010000:2.0:1782487586.402552:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.402558:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85df12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47839c expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402578:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402586:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402593:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402622:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402630:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402637:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402679:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402682:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294392448 00010000:00010000:2.0:1782487586.402688:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402691:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294392448 00010000:00010000:2.0:1782487586.402698:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.402713:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb13:0x0]: returning size 0 00000004:00200000:2.0:1782487586.402715:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00200000:1.0:1782487586.402718:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.402725:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402735:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5801 00000004:00010000:1.0:1782487586.402738:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402741:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.402749:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294613:x1869066294392448:12345-192.168.202.21@tcp:35:touch.500 00010000:00010000:1.0:1782487586.402756:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402759:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402774:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402780:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402781:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402793:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402797:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402799:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb541391600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.402803:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.402804:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402807:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402820:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402820:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402842:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.402844:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.402849:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402852:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.402856:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb541391600/0x66475b4e8b85df19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402857:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.402864:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402869:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402872:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb5735d6200/0x66475b4e8b85de16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402882:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402890:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402893:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402897:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb551526e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.402902:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402905:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402915:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402916:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402932:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.402935:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb547ee5600) 00010000:00010000:1.0:1782487586.402936:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402939:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.402943:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402947:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402950:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551526e00/0x66475b4e8b85df20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402966:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb543a0de00) 00010000:00010000:1.0:1782487586.402971:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.402975:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.402982:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57edffa00/0x66475b4e8b85de1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.402985:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f586400/0x66475b4e8b85df12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47839c expref: 1222 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403002:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47839c expref: 1221 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.403009:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1222:294613:x1869066294392448:12345-192.168.202.21@tcp:35:touch.500 Request processed in 261us (6849us total) trans 8589957006 rc 0/0 00010000:00010000:2.0:1782487586.403013:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:1.0:1782487586.403016:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb46fd07a00/0x66475b4e8b85de0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1222 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403020:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.403024:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558d86800, rc 0) 00000100:00100000:3.0:1782487586.403027:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5801 00010000:00010000:2.0:1782487586.403031:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.403042:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85df2e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783aa expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403042:0:190303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1220 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.403062:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1161 00010000:00010000:1.0:1782487586.403071:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1221 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.403073:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1221:2362:x1869066294392704:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487586.403085:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4baf8d200, rc 0) 00010000:00010000:2.0:1782487586.403090:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403097:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.403100:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403108:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85df3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478333 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403109:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.403123:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb560a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1221:2361:x1869066294392192:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 6635us (7134us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.403133:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1159 00010000:00010000:2.0:1782487586.403135:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403142:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403150:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.403155:0:190303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1162 00010000:00010000:3.0:1782487586.403161:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.403172:0:190303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1221:2360:x1869066294392960:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487586.403175:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403188:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403211:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403214:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.403216:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403224:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403226:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85df5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478428 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403246:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403247:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403260:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403266:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403270:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.403272:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00000004:00200000:2.0:1782487586.403278:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.403287:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.403290:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403305:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403307:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403318:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403322:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403327:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403333:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403335:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403341:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403352:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a03800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.403357:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403358:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403368:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403373:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403379:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.403382:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.403386:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.403392:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00010000:00010000:2.0:1782487586.403393:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03800/0x66475b4e8b85df35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.403398:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.403407:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403410:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.403414:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403422:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403429:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403437:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403437:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403456:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.403459:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403460:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403462:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403481:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403481:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.403488:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb13:0x0]: returning size 0 00000004:00200000:1.0:1782487586.403494:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.403501:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403501:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb547ee5e00) 00010000:00010000:2.0:1782487586.403505:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1782487586.403505:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403510:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403530:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403531:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464668200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.403531:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02e00/0x66475b4e8b85df43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403538:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403553:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403562:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403568:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403570:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403573:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578d71600/0x66475b4e8b85df2e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783aa expref: 1223 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403583:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.403590:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403596:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.403598:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783aa expref: 1222 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403603:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.403640:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403641:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403656:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:3.0:1782487586.403659:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668200/0x66475b4e8b85df4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403661:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.403661:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.403666:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a0a02400, rc 0) 00010000:00010000:1.0:1782487586.403668:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.403674:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403675:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.403680:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403681:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d025bc00/0x66475b4e8b85df66 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403685:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03e00/0x66475b4e8b85df82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783b8 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403701:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403707:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403710:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403716:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403730:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464669a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.403738:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403740:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403740:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403758:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403760:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403761:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403778:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.403781:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403784:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403791:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb547ee5e00) 00010000:00010000:3.0:1782487586.403798:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.403799:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403800:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403803:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403820:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403821:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669a00/0x66475b4e8b85df58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403824:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb56d889800) 00010000:00010000:1.0:1782487586.403832:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.403838:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403846:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb400/0x66475b4e8b85df6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403864:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498600/0x66475b4e8b85df3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478333 expref: 1224 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403876:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6800/0x66475b4e8b85df5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478428 expref: 1224 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403882:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403883:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478333 expref: 1224 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403892:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478428 expref: 1223 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403900:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403905:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:3.0:1782487586.403914:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.403915:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:2.0:1782487586.403917:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403918:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb464669200, rc 0) 00010000:00010000:1.0:1782487586.403920:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.403926:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.403926:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb578deb000, rc 0) 00000004:00200000:2.0:1782487586.403934:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00010000:00010000:1.0:1782487586.403934:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.403937:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668600/0x66475b4e8b85df9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47833a expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.403938:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.403948:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403956:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b85dfa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47842f expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403962:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403966:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403976:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403984:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.403988:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.403991:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.403992:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404012:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404014:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404033:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.404034:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404035:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404037:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404053:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404056:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404063:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404064:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404067:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.404073:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.404079:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404082:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404088:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02c00/0x66475b4e8b85df89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404095:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404101:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404110:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404116:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404121:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.404124:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404129:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404134:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404137:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb547ee5f00) 00010000:00010000:3.0:1782487586.404143:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404143:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.404148:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404152:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404156:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02200/0x66475b4e8b85df90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404164:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.404165:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00000004:00200000:3.0:1782487586.404170:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.404175:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03e00/0x66475b4e8b85df82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b8 expref: 1226 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404177:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.404181:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404194:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b8 expref: 1225 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404211:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404212:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404230:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404230:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.404236:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000004:00200000:1.0:1782487586.404238:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00010000:00010000:3.0:1782487586.404240:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404241:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a0a03a00, rc 0) 00000004:00200000:1.0:1782487586.404242:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.404249:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:1.0:1782487586.404253:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404254:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404259:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03200/0x66475b4e8b85dfd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783c6 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404270:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464668800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.404270:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404275:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404280:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404286:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404288:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404303:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404304:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404305:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404326:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404327:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.404330:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.404337:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.404340:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404342:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404345:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404347:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668800/0x66475b4e8b85dfac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404361:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404367:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404368:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404376:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.404383:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.404385:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404387:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404388:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404399:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404402:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1800/0x66475b4e8b85dfb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404416:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464669600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.404420:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404424:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404430:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404447:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb547ee5f00) 00010000:00010000:1.0:1782487586.404447:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404449:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404453:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.404458:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404466:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404472:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404473:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669600/0x66475b4e8b85dfba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404477:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.404484:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404494:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404495:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404514:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb4549e8600) 00010000:00010000:3.0:1782487586.404516:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668600/0x66475b4e8b85df9e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47833a expref: 1227 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.404516:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00010000:00010000:1.0:1782487586.404520:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1782487586.404522:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.404526:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.404533:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404537:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0e00/0x66475b4e8b85dfc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404540:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47833a expref: 1226 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404562:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.404562:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404567:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.404572:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb464668a00, rc 0) 00010000:00010000:2.0:1782487586.404575:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404577:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1000/0x66475b4e8b85dfa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47842f expref: 1227 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404579:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.404589:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404591:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668000/0x66475b4e8b85dff2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478341 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404598:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47842f expref: 1226 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404603:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404629:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:1.0:1782487586.404634:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.404637:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.404638:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a1ce0400, rc 0) 00010000:00010000:2.0:1782487586.404642:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404643:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.404651:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404652:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404653:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1e00/0x66475b4e8b85e000 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478436 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404670:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.404673:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.404676:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404679:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404687:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02600/0x66475b4e8b85dfdd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404687:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404692:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404708:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404710:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404716:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404720:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404731:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404737:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404739:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404746:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404759:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.404760:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404761:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404764:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404776:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404782:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404792:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb547ee5400) 00010000:00010000:2.0:1782487586.404794:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.404797:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404802:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02800/0x66475b4e8b85dfe4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404820:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03200/0x66475b4e8b85dfd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 1229 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404832:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03600/0x66475b4e8b85dfeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783c6 expref: 1228 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404841:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.404843:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.404846:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a0a03600, rc 0) 00010000:00010000:2.0:1782487586.404850:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.404857:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02a00/0x66475b4e8b85e01c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783d4 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404877:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404882:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404884:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404885:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404893:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404906:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404909:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404909:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404927:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404932:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.404936:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.404937:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00000004:00200000:1.0:1782487586.404944:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.404953:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.404960:0:213217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00000004:00010000:1.0:1782487586.404963:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.404965:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.404977:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.404982:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404988:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.404995:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.404997:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405001:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405020:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405021:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405021:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405042:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405051:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.405058:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.405060:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.405061:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405065:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.405068:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405074:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464669400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.405082:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405083:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405095:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405111:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405111:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405129:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405136:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.405137:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405143:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.405148:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405152:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a02000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.405153:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.405154:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0c00/0x66475b4e8b85e007 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405161:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.405168:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405168:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405169:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405189:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669400/0x66475b4e8b85dff9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405189:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405195:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405221:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.405223:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405224:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.405228:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405229:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405234:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.405241:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405252:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405253:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02000/0x66475b4e8b85e023 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405254:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405273:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405279:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb541321c00) 00010000:00010000:3.0:1782487586.405280:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464669c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.405280:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405287:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.405289:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405291:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405293:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405304:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405312:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405313:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0200/0x66475b4e8b85e015 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405320:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb547ee5400) 00010000:00010000:3.0:1782487586.405328:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.405328:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a0a03400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.405335:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405336:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405352:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405353:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669c00/0x66475b4e8b85e00e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405355:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1e00/0x66475b4e8b85e000 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478436 expref: 1230 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405372:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb547ee5800) 00010000:00010000:2.0:1782487586.405375:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.405379:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405386:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03400/0x66475b4e8b85e038 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405386:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478436 expref: 1229 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405398:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668000/0x66475b4e8b85dff2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 1230 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405408:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:1.0:1782487586.405413:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.405417:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a1ce1a00, rc 0) 00010000:00010000:3.0:1782487586.405422:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669000/0x66475b4e8b85e031 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478341 expref: 1230 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405423:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.405424:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02a00/0x66475b4e8b85e01c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 1230 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405434:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1200/0x66475b4e8b85e046 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47843d expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405445:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.405449:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.405451:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03c00/0x66475b4e8b85e03f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783d4 expref: 1230 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405453:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb464669000, rc 0) 00010000:00010000:3.0:1782487586.405461:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.405462:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.405465:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405466:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:2.0:1782487586.405470:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a0a03c00, rc 0) 00010000:00010000:3.0:1782487586.405471:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669800/0x66475b4e8b85e054 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478348 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405477:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.405478:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405487:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03000/0x66475b4e8b85e05b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783e9 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405490:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405500:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405513:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405515:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405522:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405531:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405535:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405541:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405557:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405557:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405558:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405581:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405590:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405598:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405625:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405634:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405665:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405676:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405687:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405704:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.405705:0:190303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00000004:00200000:1.0:1782487586.405711:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.405712:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405721:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.405725:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405726:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405735:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405749:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405749:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.405760:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.405769:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.405775:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782487586.405777:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405778:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.405787:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405797:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405798:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405814:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405817:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.405818:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405829:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405834:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405837:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405838:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405856:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405863:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464668e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.405863:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405865:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405870:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405879:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb44fb74c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.405889:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405891:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405891:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.405899:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.405906:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405907:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405910:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.405917:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.405921:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405925:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0600/0x66475b4e8b85e04d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405926:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.405927:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668e00/0x66475b4e8b85e062 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405932:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.405938:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405947:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44fb74c00/0x66475b4e8b85e070 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405951:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405953:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405958:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405975:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405978:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.405983:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.405994:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.405998:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406003:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406013:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb464668400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.406017:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f8400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.406021:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406022:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406022:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.406029:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406041:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406049:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406056:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406060:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb547ee5c00) 00010000:00010000:2.0:1782487586.406065:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.406070:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb541321e00) 00010000:00010000:2.0:1782487586.406071:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406075:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb579f0f700) 00010000:00010000:1.0:1782487586.406078:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.406082:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.406084:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406085:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8400/0x66475b4e8b85e07e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406086:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406104:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668400/0x66475b4e8b85e077 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406104:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0800/0x66475b4e8b85e069 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406118:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03000/0x66475b4e8b85e05b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 1233 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406135:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9e00/0x66475b4e8b85e093 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e9 expref: 1232 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406143:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:2.0:1782487586.406145:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.406147:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669800/0x66475b4e8b85e054 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 1234 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406149:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d47f9e00, rc 0) 00010000:00010000:1.0:1782487586.406152:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1200/0x66475b4e8b85e046 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 1234 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406167:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669e00/0x66475b4e8b85e08c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478348 expref: 1232 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406174:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1600/0x66475b4e8b85e085 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47843d expref: 1232 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406175:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487586.406180:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1782487586.406184:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb464669e00, rc 0) 00000100:00100000:2.0:1782487586.406187:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1232:2363:x1869066294392576:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 5939us (10140us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487586.406190:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.406193:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:3.0:1782487586.406212:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668c00/0x66475b4e8b85e09a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47834f expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406215:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1782487586.406219:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1160 00010000:00010000:1.0:1782487586.406221:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a1ce1600, rc 0) 00010000:00010000:1.0:1782487586.406229:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.406239:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0a00/0x66475b4e8b85e0a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478444 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406245:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.406248:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1163 00010000:00010000:3.0:1782487586.406259:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.406261:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579c1e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1233:2360:x1869066294393088:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:1.0:1782487586.406267:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406277:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406280:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406292:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406293:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.406295:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406304:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8c00/0x66475b4e8b85e0bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783f0 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406311:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406313:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406322:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406326:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406330:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406338:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406342:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406352:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406367:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406373:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406379:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406394:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406402:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406408:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782487586.406423:0:213217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.406428:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.406432:0:213217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406440:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406441:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406447:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406465:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406465:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406465:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406486:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406488:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.406493:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.406506:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.406508:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406511:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7e00 already unused, calling callback (ffffffffc21ae4f0) 00000004:00200000:2.0:1782487586.406513:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb11:0x0]: returning size 0 00010000:00010000:3.0:1782487586.406517:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.406519:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.406525:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406528:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.406532:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406544:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406548:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406555:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406563:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406564:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406578:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406585:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406589:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.406589:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.406595:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.406598:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406598:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f8200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.406600:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406621:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7e00/0x66475b4e8b85e0a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406625:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406631:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406633:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406641:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406653:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406653:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406656:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.406662:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.406668:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406669:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4cbdc7600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.406673:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406676:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.406684:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.406690:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406695:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8200/0x66475b4e8b85e0cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406697:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406706:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0000/0x66475b4e8b85e0af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406719:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb579f0fa00) 00010000:00010000:2.0:1782487586.406719:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406724:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406726:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.406732:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406736:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406742:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406752:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4cbdc7600/0x66475b4e8b85e0b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406755:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406759:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406772:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f9a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.406775:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.406777:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406781:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406784:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406789:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668c00/0x66475b4e8b85e09a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 1235 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406795:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406804:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c5187900) 00010000:00010000:2.0:1782487586.406810:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.406814:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406817:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691600/0x66475b4e8b85e0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47834f expref: 1234 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406818:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb541321800) 00010000:00010000:1.0:1782487586.406825:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.406828:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9a00/0x66475b4e8b85e0d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406832:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:1.0:1782487586.406832:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406837:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782487586.406841:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691600, rc 0) 00010000:00010000:1.0:1782487586.406845:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1400/0x66475b4e8b85e0c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406846:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.406854:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85e0ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478356 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406859:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8c00/0x66475b4e8b85e0bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f0 expref: 1235 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406872:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406879:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0a00/0x66475b4e8b85e0a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 1236 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406880:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406880:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f0 expref: 1236 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406900:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406904:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.406907:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.406910:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d47f9200, rc 0) 00010000:00010000:3.0:1782487586.406911:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406912:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1c00/0x66475b4e8b85e0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478444 expref: 1235 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406915:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.406923:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406925:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8600/0x66475b4e8b85e103 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783f7 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406928:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:1.0:1782487586.406935:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:1.0:1782487586.406940:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4a1ce1c00, rc 0) 00010000:00010000:3.0:1782487586.406943:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.406947:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.406957:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406967:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406974:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406985:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.406986:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.406995:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407000:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407002:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407016:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.407018:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407021:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407031:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407041:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.407045:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.407048:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407057:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e0f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407070:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407073:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407075:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407091:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407094:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407095:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.407100:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407106:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407107:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407126:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb579f0fc00) 00010000:00010000:3.0:1782487586.407129:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1782487586.407129:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb13:0x0]: returning size 0 00010000:00010000:3.0:1782487586.407134:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.407134:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1782487586.407142:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85e0fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.407146:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407156:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407166:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85e0ee lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478356 expref: 1236 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407166:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407184:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407195:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407197:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.407292:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.407295:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f8800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.407297:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690a00/0x66475b4e8b85e0ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478356 expref: 1236 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407300:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.407311:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de690a00, rc -2) 00010000:00010000:2.0:1782487586.407311:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407323:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.407326:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.407329:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407335:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8800/0x66475b4e8b85e10a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407345:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407352:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407358:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407363:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f9600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.407366:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407371:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407377:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb56c096f00) 00010000:00010000:2.0:1782487586.407380:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.407382:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407387:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9600/0x66475b4e8b85e111 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.407399:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1235:2362:x1869066294392704:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 4328us (11319us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487586.407408:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1161 00010000:00010000:2.0:1782487586.407409:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8600/0x66475b4e8b85e103 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f7 expref: 1236 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407421:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f7 expref: 1234 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407428:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:2.0:1782487586.407431:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.407434:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d47f8a00, rc 0) 00010000:00010000:2.0:1782487586.407438:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.407446:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8000/0x66475b4e8b85e11f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4783fe expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407464:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407472:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407472:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e12d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47844b expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407491:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407505:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407511:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407513:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407525:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407529:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407541:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407555:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407563:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407571:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407573:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407586:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407593:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.407622:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb12:0x0]: returning size 0 00000004:00200000:2.0:1782487586.407625:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.407634:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407643:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407650:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407656:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407660:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407663:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407676:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f9400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.407677:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407679:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407694:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407696:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407707:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.407711:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.407715:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.407715:0:190303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1782487586.407724:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9400/0x66475b4e8b85e126 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.407729:0:190303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407734:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407753:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407756:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407763:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407770:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f9c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.407770:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407775:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407781:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407785:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407793:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407796:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb5517d5c00) 00010000:00010000:2.0:1782487586.407802:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.407805:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.407806:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407812:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407815:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9c00/0x66475b4e8b85e134 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407825:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407839:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.407841:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8000/0x66475b4e8b85e11f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783fe expref: 1237 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407842:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.407848:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407857:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780400/0x66475b4e8b85e13b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407858:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783fe expref: 1236 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407875:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:2.0:1782487586.407877:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.407880:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4d47f9000, rc 0) 00010000:00010000:1.0:1782487586.407880:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407886:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.407891:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407893:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9800/0x66475b4e8b85e157 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478405 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407906:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407913:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.407917:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407919:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407930:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407933:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407944:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407944:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb55a37b100) 00010000:00010000:1.0:1782487586.407951:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.407956:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407962:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781e00/0x66475b4e8b85e142 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407968:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407976:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.407983:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.407992:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e12d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 1238 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408009:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780c00/0x66475b4e8b85e150 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47844b expref: 1237 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408018:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:1.0:1782487586.408021:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.408023:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db780c00, rc 0) 00010000:00010000:1.0:1782487586.408029:0:190303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.408030:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408039:0:190303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780200/0x66475b4e8b85e173 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478452 expref: -99 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408040:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408058:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.408071:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00010000:00010000:1.0:1782487586.408073:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.408074:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.408086:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.408087:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408100:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408103:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408118:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408126:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408126:0:190303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408146:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408148:0:190303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408155:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d47f8e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408160:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408160:0:190303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408175:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408185:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.408189:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408192:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408197:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8e00/0x66475b4e8b85e15e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408211:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408224:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408227:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408229:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408241:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408244:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408245:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408259:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408263:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408268:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408271:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408274:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.408279:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408281:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408282:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408297:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e17a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408301:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb5517d5b00) 00010000:00010000:2.0:1782487586.408304:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408307:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408308:0:190303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408325:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8400/0x66475b4e8b85e165 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408325:0:190303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408342:0:190303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408348:0:190303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.408351:0:190303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408356:0:190303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408359:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9800/0x66475b4e8b85e157 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478405 expref: 1239 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408364:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb5456e5e00) 00010000:00010000:1.0:1782487586.408369:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.408372:0:190303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408376:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478405 expref: 1238 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408380:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408392:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.408396:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.408398:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a9e00, rc 0) 00010000:00010000:2.0:1782487586.408402:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.408409:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8c00/0x66475b4e8b85e188 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47840c expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408412:0:190303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780200/0x66475b4e8b85e173 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478452 expref: 1238 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408428:0:190303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.408430:0:190303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.408433:0:190303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780200/0x66475b4e8b85e173 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478452 expref: 1239 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408438:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.408440:0:190303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db780200, rc -2) 00010000:00010000:2.0:1782487586.408450:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408457:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408468:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408475:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408481:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.408485:0:190303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2360:x1869066294392960:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 5321us (12376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782487586.408495:0:190303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1162 00010000:00010000:2.0:1782487586.408537:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408546:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408553:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.408564:0:213216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00000004:00200000:2.0:1782487586.408566:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.408574:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408582:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408589:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408594:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408600:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408604:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408623:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408629:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408637:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.408640:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408643:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408649:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8200/0x66475b4e8b85e18f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408657:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408663:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408669:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408674:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408676:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408682:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408689:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5517d5300) 00010000:00010000:2.0:1782487586.408691:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408693:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408698:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9a00/0x66475b4e8b85e196 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408716:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8c00/0x66475b4e8b85e188 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 1238 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408726:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9200/0x66475b4e8b85e19d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47840c expref: 1237 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408733:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.408735:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.408737:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a9200, rc 0) 00010000:00010000:2.0:1782487586.408741:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.408747:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8600/0x66475b4e8b85e1a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478413 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408764:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408771:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408778:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408788:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408794:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408800:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408838:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408847:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408854:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.408866:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.408873:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408881:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408887:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408893:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408899:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408904:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408907:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408913:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408920:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.408922:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408925:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408931:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8800/0x66475b4e8b85e1ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408940:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408945:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408951:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408957:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.408959:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408964:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408970:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb5517d5200) 00010000:00010000:2.0:1782487586.408972:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.408975:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408980:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9600/0x66475b4e8b85e1b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.408996:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8600/0x66475b4e8b85e1a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 1239 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409011:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8a00/0x66475b4e8b85e1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478413 expref: 1238 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409018:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.409020:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:2.0:1782487586.409023:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a8a00, rc 0) 00010000:00010000:2.0:1782487586.409026:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.409031:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8000/0x66475b4e8b85e1c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47841a expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409048:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409056:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409063:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409074:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409080:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409087:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409122:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409130:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409137:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.409149:0:213216:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.409156:0:213216:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409164:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409171:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409177:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409183:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409187:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.409190:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409196:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409215:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.409218:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.409221:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409227:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9400/0x66475b4e8b85e1c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409235:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409242:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409248:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409253:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.409255:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409261:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409267:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb4c14c1300) 00010000:00010000:2.0:1782487586.409269:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.409271:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409276:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9c00/0x66475b4e8b85e1ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409292:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8000/0x66475b4e8b85e1c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 1240 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409307:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9000/0x66475b4e8b85e1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47841a expref: 1239 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409314:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:2.0:1782487586.409317:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.409318:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a9000, rc 0) 00010000:00010000:2.0:1782487586.409322:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.409328:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9800/0x66475b4e8b85e1dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478460 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409345:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409353:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409359:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409380:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409386:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409393:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409416:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409423:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409429:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409434:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.409436:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409442:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409449:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.409451:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.409454:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409460:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a8e00/0x66475b4e8b85e1e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409468:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409474:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409480:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409485:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.409488:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409495:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409501:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c14c1400) 00010000:00010000:2.0:1782487586.409503:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.409505:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409511:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163800/0x66475b4e8b85e1ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409527:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9800/0x66475b4e8b85e1dc lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478460 expref: 1240 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409534:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.409536:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.409539:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9800/0x66475b4e8b85e1dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478460 expref: 1240 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.409547:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4543a9800, rc -2) 00000100:00100000:2.0:1782487586.409587:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579c1e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2360:x1869066294393088:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 3329us (13438us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782487586.409594:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1163 00000100:00100000:1.0:1782487586.413111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.413144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.413160:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393216 00000100:00100000:1.0:1782487586.413168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.413169:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393216 00000100:00100000:3.0:1782487586.413189:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393472 00000100:00100000:1.0:1782487586.413191:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393344 00000100:00100000:3.0:1782487586.413195:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393472 00000100:00100000:1.0:1782487586.413196:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393344 00000100:00100000:2.0:1782487586.413249:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16260 00000100:00100000:1.0:1782487586.413262:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16261 00000100:00100000:2.0:1782487586.413264:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2362:x1869066294393216:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:3.0:1782487586.413265:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1171 00000100:00100000:1.0:1782487586.413276:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2361:x1869066294393344:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:3.0:1782487586.413282:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2361:x1869066294393472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487586.413283:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.413287:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.413300:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.413307:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47846e expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.413309:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478467 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.413333:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6200/0x66475b4e8b85deb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478379 expref: 1239 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.413345:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x185b:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00002000:00010000:1.0:1782487586.413346:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1880:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.413354:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:3.0:1782487586.413359:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.413361:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.413366:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.413373:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.413374:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 137 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.413381:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.413394:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 110 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.413399:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2361:x1869066294393472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487586.413399:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 137 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.413419:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1171 00010000:00010000:2.0:1782487586.413425:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 110 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.413425:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db781600, rc 0) 00010000:00010000:2.0:1782487586.413439:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca162e00, rc 0) 00000100:00100000:1.0:1782487586.413467:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2361:x1869066294393344:12345-192.168.202.21@tcp:101:rm.500 Request processed in 190us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.413468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.413473:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2362:x1869066294393216:12345-192.168.202.21@tcp:101:rm.500 Request processed in 211us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.413480:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16261 00000100:00100000:2.0:1782487586.413487:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16260 00000100:00100000:1.0:1782487586.413501:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393600 00000100:00100000:1.0:1782487586.413506:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393600 00000100:00100000:3.0:1782487586.413522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.413532:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393984 00000100:00100000:1.0:1782487586.413535:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393984 00000100:00100000:2.0:1782487586.413543:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16262 00000100:00100000:2.0:1782487586.413561:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2360:x1869066294393600:12345-192.168.202.21@tcp:101:rm.500 00000100:00100000:1.0:1782487586.413564:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16263 00010000:00010000:2.0:1782487586.413573:0:213224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.413578:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066294393984:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.413585:0:190928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.413587:0:213224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478475 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.413598:0:190928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47847c expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.413604:0:213224:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1881:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.413641:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.413646:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.413654:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 138 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.413668:0:213224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 138 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.413680:0:213224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca162400, rc 0) 00000100:00100000:2.0:1782487586.413707:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:5c4ca15f-f34e-4111-b105-de67ffe3ec92+138:2360:x1869066294393600:12345-192.168.202.21@tcp:101:rm.500 Request processed in 154us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.413716:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16262 00002000:00010000:1.0:1782487586.413737:0:190928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1859:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.413750:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.413753:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.413759:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 111 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.413771:0:190928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 111 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.413780:0:190928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db780a00, rc 0) 00000100:00100000:3.0:1782487586.413786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.413800:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2360:x1869066294393984:12345-192.168.202.21@tcp:101:rm.500 Request processed in 225us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.413806:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16263 00000100:00100000:3.0:1782487586.413834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.413858:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393856 00000100:00100000:3.0:1782487586.413862:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393856 00000100:00100000:1.0:1782487586.413872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487586.413884:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1238 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.413889:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294393728 00000100:00100000:1.0:1782487586.413894:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294393728 00000100:00100000:3.0:1782487586.413912:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394112 00000100:00100000:3.0:1782487586.413916:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394112 00000100:00100000:1.0:1782487586.413923:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16264 00000100:00100000:1.0:1782487586.413931:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2362:x1869066294393728:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:3.0:1782487586.413949:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6153 00000100:00100000:3.0:1782487586.413958:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2360:x1869066294393856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487586.413965:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.413970:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1239 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.413981:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1239 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.413993:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4baf8d200/0x66475b4e8b85de24 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x43f633357a4783db expref: 1239 pid: 190303 timeout: 7313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.414005:0:190282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:3.0:1782487586.414011:0:190282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.414027:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.414035:0:190282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.414063:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1172 00010000:00010000:3.0:1782487586.414066:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487586.414077:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2360:x1869066294394112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487586.414087:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2360:x1869066294393856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 130us (300us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.414089:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487586.414094:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6153 00010000:00010000:2.0:1782487586.414108:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558498400/0x66475b4e8b85deef lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478421 expref: 1237 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.414125:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:2.0:1782487586.414130:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.414163:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.414163:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1236:2360:x1869066294394112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.414172:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2362:x1869066294393728:12345-192.168.202.21@tcp:2:touch.500 Request processed in 239us (297us total) trans 8589940023 rc 0/0 00000100:00100000:2.0:1782487586.414177:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1172 00000100:00100000:3.0:1782487586.414183:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394240 00000100:00100000:1.0:1782487586.414187:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16264 00000100:00100000:3.0:1782487586.414188:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394240 00000100:00100000:1.0:1782487586.414219:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16265 00000100:00100000:1.0:1782487586.414228:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+138:2360:x1869066294394240:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.414234:0:213211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.414244:0:213211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478483 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.414262:0:213211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1882:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.414271:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.414274:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.414280:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 139 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.414290:0:213211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 139 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.414299:0:213211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db780200, rc 0) 00000100:00100000:1.0:1782487586.414316:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+139:2360:x1869066294394240:12345-192.168.202.21@tcp:101:rm.500 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.414321:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16265 00000100:00100000:3.0:1782487586.414474:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.414510:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394880 00000100:00100000:2.0:1782487586.414514:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394880 00000100:00100000:2.0:1782487586.414535:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213823096882 time 7213822996882 state 0x1 ref 2 00000100:00100000:3.0:1782487586.414544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.414602:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394368 00000100:00100000:1.0:1782487586.414656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.414659:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394368 00000100:00100000:2.0:1782487586.414688:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395008 00000100:00100000:3.0:1782487586.414695:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1173 00000100:00100000:2.0:1782487586.414696:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395008 00000100:00100000:1.0:1782487586.414696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.414705:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1237:2362:x1869066294394368:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487586.414716:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.414732:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c6c00/0x66475b4e8b85de47 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47832c expref: 1237 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.414749:0:190283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:3.0:1782487586.414753:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.414784:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1236:2362:x1869066294394368:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.414790:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1173 00000100:00100000:3.0:1782487586.414820:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394624 00000100:00100000:3.0:1782487586.414824:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394624 00000100:00100000:3.0:1782487586.414861:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16266 00000100:00100000:3.0:1782487586.414871:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+113:2360:x1869066294394624:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:3.0:1782487586.414881:0:192482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782487586.414894:0:192482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478491 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782487586.414951:0:192482:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x185c:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:3.0:1782487586.414964:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:3.0:1782487586.414968:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487586.414976:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 114 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.414990:0:192482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 114 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.414991:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16267 00000100:00100000:2.0:1782487586.415004:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2362:x1869066294395008:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:3.0:1782487586.415005:0:192482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691400, rc 0) 00010000:00010000:2.0:1782487586.415015:0:190931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.415027:0:190931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47849f expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.415043:0:190931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x185a:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.415053:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:2.0:1782487586.415057:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.415064:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 115 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415079:0:190931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 115 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415090:0:190931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163800, rc 0) 00000100:00100000:3.0:1782487586.415100:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2360:x1869066294394624:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 230us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.415107:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16266 00000100:00100000:2.0:1782487586.415115:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2362:x1869066294395008:12345-192.168.202.21@tcp:101:rm.500 Request processed in 112us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.415123:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16267 00010000:00010000:3.0:1782487586.415141:0:190298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.415148:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.415186:0:213218:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213823096882 time 7213836574941 state 0x0 ref 2 00000100:00100000:2.0:1782487586.415215:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1235:294621:x1869066294394880:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.415226:0:213218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.415238:0:213218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e222 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478498 expref: -99 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.415311:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006d3889b reply state 000000000657b52e transno 8589957007 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.415320:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.415387:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294615:x1869066294391424:12345-192.168.202.21@tcp:36:touch.500 Request processed in 15577us (19346us total) trans 8589957007 rc 0/0 00000100:00100000:3.0:1782487586.415393:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27174 00010000:00010000:2.0:1782487586.415448:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415462:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415471:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415484:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415493:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.415501:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487586.416036:0:213218:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185e:0x0], index 1: 0 00010000:00010000:2.0:1782487586.416229:0:213218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e237 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416241:0:213218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e237 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416250:0:213218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e237 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416280:0:213218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416292:0:213218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416300:0:213218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416307:0:213218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.416312:0:213218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416320:0:213218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416331:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.416334:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.416339:0:213218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416345:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e229 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.416359:0:213218:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021a1e966 reply state 00000000a341ebd3 transno 8589957008 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.416367:0:213218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782487586.416391:0:213218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e222 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478498 expref: 1239 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416407:0:213218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e237 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478498 expref: 1238 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.416421:0:213218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1000) 00010000:00010000:2.0:1782487586.416424:0:213218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.416427:0:213218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163a00, rc 0) 00000100:00100000:2.0:1782487586.416470:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294621:x1869066294394880:12345-192.168.202.21@tcp:101:touch.500 Request processed in 1272us (1996us total) trans 8589957008 rc 0/0 00000100:00100000:2.0:1782487586.416478:0:213218:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27180 00000100:00100000:2.0:1782487586.416485:0:213218:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213823096882 time 7213836574941 state 0x2 ref 0 00000100:00100000:1.0:1782487586.417670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.417698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.417726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.417762:0:199549:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395392 00000100:00100000:3.0:1782487586.417769:0:199549:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395392 00000100:00100000:1.0:1782487586.417777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.417795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.417915:0:199549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5802 00000100:00100000:3.0:1782487586.417923:0:199549:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294616:x1869066294395392:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.417969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.418849:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294394496 00000100:00100000:2.0:1782487586.418856:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294394496 00000100:00100000:2.0:1782487586.418899:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395136 00000100:00100000:2.0:1782487586.418902:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395136 00000100:00100000:1.0:1782487586.418918:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395648 00000100:00100000:1.0:1782487586.418923:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395648 00000100:00100000:2.0:1782487586.418933:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16268 00000100:00100000:2.0:1782487586.418946:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2360:x1869066294394496:12345-192.168.202.21@tcp:101:ll_agl.0 00000100:00100000:1.0:1782487586.418953:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395776 00000100:00100000:1.0:1782487586.418956:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395776 00010000:00010000:2.0:1782487586.418958:0:213223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.418976:0:213223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47848a expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.418980:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16269 00000100:00100000:1.0:1782487586.418991:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+140:2360:x1869066294395136:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487586.418998:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.419002:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.419008:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.419010:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784a6 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419018:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 116 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782487586.419029:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1883:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:2.0:1782487586.419037:0:213223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 116 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419040:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.419047:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.419057:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419066:0:213223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163200, rc 0) 00010000:00010000:1.0:1782487586.419070:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f1c2a4d/0x66475b4e8b85e24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784a6 expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419079:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db781e00, rc 0) 00000100:00100000:1.0:1782487586.419122:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2360:x1869066294395136:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 131us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.419124:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2360:x1869066294394496:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 179us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.419130:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16269 00000100:00100000:2.0:1782487586.419140:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16268 00000100:00100000:1.0:1782487586.419153:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16270 00000100:00100000:1.0:1782487586.419162:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+140:2362:x1869066294395648:12345-192.168.202.21@tcp:101:ll_agl.0 00000100:00100000:2.0:1782487586.419168:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16271 00010000:00010000:1.0:1782487586.419170:0:213210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782487586.419180:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2363:x1869066294395776:12345-192.168.202.21@tcp:101:ll_agl.0 00010000:00010000:1.0:1782487586.419180:0:213210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784ad expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419193:0:213223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1782487586.419211:0:213210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1884:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782487586.419220:0:213223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784b4 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419221:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.419228:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487586.419237:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782487586.419245:0:213223:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x185d:0x0] initial LVB size: 0, mtime: 0x6a3e9a22, atime: 0x6a3e9a22, ctime: 0x6a3e9a22, blocks: 0x1 00010000:00010000:1.0:1782487586.419248:0:213210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4301079/0x66475b4e8b85e253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784ad expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419260:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=7213s v=(0 0) 00010000:00010000:1.0:1782487586.419260:0:213210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db780400, rc 0) 00010000:00010000:2.0:1782487586.419267:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487586.419274:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 116 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.419287:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2362:x1869066294395648:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 125us (1489us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487586.419290:0:213223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d60cec82/0x66475b4e8b85e25a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784b4 expref: 116 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.419302:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16270 00010000:00010000:2.0:1782487586.419308:0:213223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca162600, rc 0) 00000100:00100000:2.0:1782487586.419334:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2363:x1869066294395776:12345-192.168.202.21@tcp:101:ll_agl.0 Request processed in 157us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.419342:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16271 00010000:00010000:2.0:1782487586.419392:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419401:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419409:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419416:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.419421:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419429:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.419440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.419444:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.419450:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.419454:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419462:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454b0da00/0x66475b4e8b85de40 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.419488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.419491:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395904 00000100:00100000:2.0:1782487586.419496:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395904 00000100:00100000:2.0:1782487586.419536:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16272 00000100:00100000:2.0:1782487586.419546:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+141:2362:x1869066294395904:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.419586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.419595:0:199549:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294616:x1869066294395392:12345-192.168.202.21@tcp:35:touch.500 Request processed in 1669us (1923us total) trans 8589957009 rc 0/0 00000100:00100000:3.0:1782487586.419604:0:199549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5802 00000100:00100000:3.0:1782487586.419683:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294395520 00000100:00100000:3.0:1782487586.419687:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294395520 00000100:00100000:3.0:1782487586.419720:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1174 00000100:00100000:3.0:1782487586.419728:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2361:x1869066294395520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487586.419729:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294396160 00000100:00100000:1.0:1782487586.419736:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294396160 00010000:00010000:3.0:1782487586.419740:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487586.419756:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7c00/0x66475b4e8b85dee1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783e2 expref: 1240 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.419761:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213823096882 time 7213836574941 state 0x0 ref 1 00002000:00010000:2.0:1782487586.419769:0:213222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1884:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782487586.419774:0:213222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1884:0x0] updating lvb mtime from disk: 0 -> 1782487586 00000100:00100000:1.0:1782487586.419775:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213836674941 time 7213836574941 state 0x1 ref 1 00010000:00010000:3.0:1782487586.419778:0:213392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00002000:00010000:2.0:1782487586.419781:0:213222:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x1884:0x0] updating lvb atime from disk: 0 -> 1782487586 00010000:00010000:3.0:1782487586.419786:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1782487586.419788:0:213222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1884:0x0] updating lvb ctime from disk: 0 -> 1782487586 00002000:00010000:2.0:1782487586.419791:0:213222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1884:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782487586.419800:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294396416 00000100:00100000:1.0:1782487586.419804:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294396416 00000100:00100000:3.0:1782487586.419812:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545575c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1240:2361:x1869066294395520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 84us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.419817:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213836674941 time 7213836574941 state 0x1 ref 2 00000100:00100000:3.0:1782487586.419824:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1174 00000100:00100000:2.0:1782487586.419825:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2362:x1869066294395904:12345-192.168.202.21@tcp:2:touch.500 Request processed in 277us (382us total) trans 8589940687 rc 0/0 00000100:00100000:2.0:1782487586.419839:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16272 00000100:00100000:1.0:1782487586.419847:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213841337327 time 7213841237327 state 0x1 ref 2 00000100:00100000:1.0:1782487586.419858:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294621:x1869066294396160:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:2.0:1782487586.419872:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419881:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419884:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.419891:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419899:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.419899:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e237 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478498 expref: 1239 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.419907:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419915:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1000) 00010000:00010000:2.0:1782487586.419916:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419926:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.419928:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213841337327 time 7213841317048 state 0x0 ref 2 00010000:00010000:2.0:1782487586.419932:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c14c1c00) 00010000:00010000:2.0:1782487586.419937:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.419941:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.419943:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294617:x1869066294396416:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.419954:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e230 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419969:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.419976:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782487586.419979:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.419987:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.419992:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7800/0x66475b4e8b85dbca lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782c3 expref: 1237 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420009:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54151a000/0x66475b4e8b85d9c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47825a expref: 1236 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420018:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb541321600) 00010000:00010000:3.0:1782487586.420025:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487586.420039:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420048:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.420051:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8e5ab6f reply state 00000000a9f155e6 transno 8589957010 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420059:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.420059:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.420073:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420080:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420087:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.420108:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1237:294621:x1869066294396160:12345-192.168.202.21@tcp:36:touch.500 Request processed in 252us (622us total) trans 8589957010 rc 0/0 00000100:00100000:1.0:1782487586.420115:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27181 00010000:00010000:3.0:1782487586.420174:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420181:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420189:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782487586.420661:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2558, 64 off171904 00010000:00010000:3.0:1782487586.420702:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420711:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420924:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420931:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420937:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420943:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420957:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487586.420968:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420974:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420980:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.420990:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.420994:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421000:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421008:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb579f0fd00) 00010000:00010000:3.0:1782487586.421011:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.421014:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421020:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691000/0x66475b4e8b85e276 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421031:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421038:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421043:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421048:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.421051:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421057:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421067:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.421070:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.421072:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.421078:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85e268 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782487586.421085:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089d08f6b reply state 0000000053fb7638 transno 8589957011 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.421091:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782487586.421126:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294617:x1869066294396416:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1186us (1541us total) trans 8589957011 rc 0/0 00000100:00100000:3.0:1782487586.421133:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27182 00000100:00100000:3.0:1782487586.421137:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213841337327 time 7213841317048 state 0x2 ref 0 00010000:00010000:2.0:1782487586.421269:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.421277:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421285:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.421289:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421296:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421307:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0d:0x0].0x0 (ffff9cb579f0fd00) 00010000:00010000:2.0:1782487586.421310:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.421314:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421320:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691800/0x66475b4e8b85e27d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421338:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.421341:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.421345:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.421359:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421369:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.421369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.421380:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421387:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.421391:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.421403:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294396544 00010000:00010000:2.0:1782487586.421404:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.421410:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294396544 00000100:00100000:1.0:1782487586.421415:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.421418:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb5456e5100) 00010000:00010000:2.0:1782487586.421423:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.421426:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421434:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e261 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.421437:0:190301:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294396800 00000100:00100000:3.0:1782487586.421442:0:190301:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294396800 00000100:00100000:3.0:1782487586.421472:0:190301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5803 00000100:00100000:3.0:1782487586.421480:0:190301:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294615:x1869066294396800:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:2.0:1782487586.421670:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213841337327 time 7213841317048 state 0x0 ref 1 00000100:00100000:2.0:1782487586.421680:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213841417048 time 7213841317048 state 0x1 ref 1 00000100:00100000:2.0:1782487586.421707:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213841417048 time 7213843097259 state 0x0 ref 1 00000100:00100000:3.0:1782487586.421721:0:190301:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294615:x1869066294396800:12345-192.168.202.21@tcp:35:touch.500 Request processed in 241us (306us total) trans 8589957012 rc 0/0 00000100:00100000:3.0:1782487586.421729:0:190301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5803 00010000:00010000:2.0:1782487586.421737:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421745:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421752:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421758:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.421763:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421770:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421781:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x82ce4fa8 (ffff9cb579f0f700) 00010000:00010000:2.0:1782487586.421785:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.421788:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421795:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690000/0x66475b4e8b85e26f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x82ce4fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.421827:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1237:294621:x1869066294396544:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:2.0:1782487586.421835:0:190298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.421846:0:190298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162800/0x66475b4e8b85e284 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784bb expref: -99 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421880:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162800/0x66475b4e8b85e284 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784bb expref: 1238 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421893:0:190298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162800/0x66475b4e8b85e284 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784bb expref: 1238 pid: 190298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.421906:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:2.0:1782487586.421909:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782487586.421911:0:190298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca162800, rc 0) 00000100:00100000:2.0:1782487586.421942:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4546d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294621:x1869066294396544:12345-192.168.202.21@tcp:101:touch.500 Request processed in 226us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.421949:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27183 00000100:00100000:2.0:1782487586.421953:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213841417048 time 7213843097259 state 0x2 ref 0 00000100:00100000:1.0:1782487586.422245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.422345:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294396928 00000100:00100000:2.0:1782487586.422351:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294396928 00000100:00100000:2.0:1782487586.422369:0:190296:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213841417048 time 7213843097259 state 0x0 ref 1 00000100:00100000:2.0:1782487586.422378:0:190296:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843197259 time 7213843097259 state 0x1 ref 1 00000100:00100000:2.0:1782487586.422408:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843197259 time 7213843799116 state 0x0 ref 1 00000100:00100000:2.0:1782487586.422420:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294625:x1869066294396928:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.422429:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.422440:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e28b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784c2 expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422478:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422488:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422498:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422513:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422520:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422528:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422641:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422652:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422661:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.422684:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb14:0x0]: returning size 0 00000004:00200000:2.0:1782487586.422688:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.422702:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422713:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422721:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422727:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422734:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422740:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.422744:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422751:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422762:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.422765:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.422768:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422775:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e292 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422788:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422796:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422802:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422808:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.422812:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422819:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422829:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb5517d5200) 00010000:00010000:2.0:1782487586.422832:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.422845:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422855:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e299 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422889:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e28b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c2 expref: 1240 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422905:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c2 expref: 1239 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.422913:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.422916:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.422920:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163400, rc 0) 00000100:00100000:2.0:1782487586.422960:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294625:x1869066294396928:12345-192.168.202.21@tcp:101:rm.500 Request processed in 541us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.422968:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27184 00000100:00100000:2.0:1782487586.422974:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843197259 time 7213843799116 state 0x2 ref 0 00000100:00100000:1.0:1782487586.425537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.425583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487586.425652:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397184 00000100:00100000:3.0:1782487586.425659:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397184 00000100:00100000:3.0:1782487586.425704:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16273 00000100:00100000:3.0:1782487586.425712:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2361:x1869066294397184:12345-192.168.202.21@tcp:2:touch.500 00000100:00100000:1.0:1782487586.425721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.425857:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397312 00000100:00100000:2.0:1782487586.425862:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397312 00000100:00100000:2.0:1782487586.425906:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1175 00000100:00100000:2.0:1782487586.425917:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2362:x1869066294397312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487586.425930:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487586.425952:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e2a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c2 expref: 1239 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.425969:0:192528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.425974:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487586.425995:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2361:x1869066294397184:12345-192.168.202.21@tcp:2:touch.500 Request processed in 281us (410us total) trans 8589940024 rc 0/0 00000100:00100000:2.0:1782487586.426002:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:2362:x1869066294397312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487586.426008:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16273 00000100:00100000:2.0:1782487586.426020:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1175 00000100:00100000:2.0:1782487586.426049:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397056 00000100:00100000:2.0:1782487586.426053:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397056 00000100:00100000:2.0:1782487586.426068:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843197259 time 7213843799116 state 0x0 ref 1 00000100:00100000:2.0:1782487586.426078:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843899116 time 7213843799116 state 0x1 ref 1 00000100:00100000:2.0:1782487586.426098:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843899116 time 7213847489198 state 0x0 ref 1 00000100:00100000:2.0:1782487586.426107:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1238:294636:x1869066294397056:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.426118:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.426129:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e2a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784c9 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426187:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426212:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426224:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426240:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426249:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426257:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426376:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426387:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426396:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.426422:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb15:0x0]: returning size 0 00000004:00200000:2.0:1782487586.426426:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782487586.426440:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426451:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426461:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426468:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426476:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426483:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.426487:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426496:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426507:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.426510:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.426515:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426521:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e2ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426533:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426540:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426546:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426552:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.426556:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426563:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426573:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7516c0a8 (ffff9cb5517d5300) 00010000:00010000:2.0:1782487586.426576:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.426580:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426586:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x7516c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426642:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e2a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c9 expref: 1240 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426658:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c9 expref: 1239 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.426666:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:2.0:1782487586.426670:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.426673:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163c00, rc 0) 00000100:00100000:2.0:1782487586.426700:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294636:x1869066294397056:12345-192.168.202.21@tcp:101:rm.500 Request processed in 592us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.426708:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27185 00000100:00100000:2.0:1782487586.426714:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843899116 time 7213847489198 state 0x2 ref 0 00000100:00100000:3.0:1782487586.427747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.427888:0:190300:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397568 00000100:00100000:1.0:1782487586.427895:0:190300:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397568 00000100:00100000:3.0:1782487586.427937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.427949:0:190300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5804 00000100:00100000:1.0:1782487586.427960:0:190300:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294621:x1869066294397568:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:1.0:1782487586.428251:0:190300:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1240:294621:x1869066294397568:12345-192.168.202.21@tcp:35:touch.500 Request processed in 292us (504us total) trans 8589957013 rc 0/0 00000100:00100000:1.0:1782487586.428261:0:190300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5804 00000100:00100000:1.0:1782487586.428303:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397696 00000100:00100000:1.0:1782487586.428308:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397696 00000100:00100000:1.0:1782487586.428351:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1176 00000100:00100000:1.0:1782487586.428361:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1240:2360:x1869066294397696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.428372:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.428388:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e2bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784c9 expref: 1240 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.428404:0:192469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb15:0x0].0x0 (ffff9cb4c5187600) 00010000:00010000:1.0:1782487586.428409:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.428444:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:2360:x1869066294397696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.428453:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1176 00000100:00100000:3.0:1782487586.429178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.429241:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294397952 00000100:00100000:1.0:1782487586.429247:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294397952 00000100:00100000:1.0:1782487586.429267:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213843899116 time 7213847489198 state 0x0 ref 1 00000100:00100000:1.0:1782487586.429277:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213847589198 time 7213847489198 state 0x1 ref 1 00000100:00100000:1.0:1782487586.429299:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213847589198 time 7213850690149 state 0x0 ref 1 00000100:00100000:1.0:1782487586.429311:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1239:294623:x1869066294397952:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.429343:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:1.0:1782487586.429360:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9000/0x66475b4e8b85e149 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783fe expref: 1239 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429388:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce0400/0x66475b4e8b85dfcf lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47842f expref: 1238 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429407:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464669200/0x66475b4e8b85df74 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478333 expref: 1237 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429425:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb547117200/0x66475b4e8b85ddd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b1 expref: 1236 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429538:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a02400/0x66475b4e8b85df51 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783aa expref: 1235 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429556:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb579f30400/0x66475b4e8b85dea9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47836b expref: 1234 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429571:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7e00/0x66475b4e8b85dc80 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782ed expref: 1233 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429585:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb5432e7200) 00010000:00010000:1.0:1782487586.429594:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.429627:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429638:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429649:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429665:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429672:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429680:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429792:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429802:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.429810:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.430280:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2552, 64 off171520 00010000:00010000:1.0:1782487586.430353:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430361:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430368:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430374:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430379:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430383:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430400:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.430412:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430416:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430420:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430424:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.430427:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430432:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430439:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb4c14c1c00) 00010000:00010000:1.0:1782487586.430442:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.430444:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.430444:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430451:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e2d1 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.430454:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430463:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.430464:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.430474:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430474:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430488:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430494:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.430495:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430498:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430511:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.430520:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.430525:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.430528:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.430534:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb12:0x0].0x0 (ffff9cb4c14c1c00) 00010000:00010000:1.0:1782487586.430535:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e2c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.430542:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.430548:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.430555:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064070eb6 reply state 0000000064b12f42 transno 8589957014 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.430557:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e2d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.430574:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.430589:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.430594:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.430597:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487586.430653:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1234:294623:x1869066294397952:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1345us (1475us total) trans 8589957014 rc 0/0 00000100:00100000:1.0:1782487586.430661:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27186 00000100:00100000:1.0:1782487586.430666:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213847589198 time 7213850690149 state 0x2 ref 0 00010000:00010000:2.0:1782487586.431303:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431315:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431322:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431328:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.431333:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431340:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431351:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xef18c0a8 (ffff9cb5456e5100) 00010000:00010000:2.0:1782487586.431355:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.431358:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.431365:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e2ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xef18c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.431845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.431889:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294398208 00000100:00100000:2.0:1782487586.431897:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294398208 00000100:00100000:2.0:1782487586.431925:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213847589198 time 7213850690149 state 0x0 ref 1 00000100:00100000:2.0:1782487586.431946:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213850790149 time 7213850690149 state 0x1 ref 1 00000100:00100000:2.0:1782487586.431974:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213850790149 time 7213853363785 state 0x0 ref 1 00000100:00100000:2.0:1782487586.431986:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1233:294620:x1869066294398208:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.432026:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782487586.432045:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548f4c200/0x66475b4e8b85dd75 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478387 expref: 1233 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432068:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4aabb1400/0x66475b4e8b85de7f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478380 expref: 1232 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432087:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb546d37200/0x66475b4e8b85db7d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782bc expref: 1231 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432098:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb4549e8b00) 00010000:00010000:2.0:1782487586.432107:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.432124:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432135:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432145:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432159:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432167:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432176:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432280:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432288:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432296:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.432760:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2553, 64 off171584 00000100:00100000:3.0:1782487586.432820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.432826:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432834:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432841:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432847:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432851:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432855:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.432862:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294398336 00000100:00100000:1.0:1782487586.432867:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294398336 00010000:00010000:2.0:1782487586.432874:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.432891:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432897:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432904:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432911:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163000 already unused, calling callback (ffffffffc21ae4f0) 00000100:00100000:1.0:1782487586.432912:0:213491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1164 00010000:00010000:2.0:1782487586.432917:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.432927:0:213491:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1232:2363:x1869066294398336:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487586.432929:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432942:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:2.0:1782487586.432944:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.432947:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432951:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e2ed lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.432963:0:213491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.432964:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432971:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.432972:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.432974:0:213491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e2fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784d0 expref: -99 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.432984:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.432984:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.433005:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.433005:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.433005:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.433013:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.433014:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433016:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.433037:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433037:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.433038:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433063:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.433065:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.433067:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb10:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:2.0:1782487586.433072:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.433075:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.433077:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.433082:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433089:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.433093:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e2df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.433104:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e2f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433107:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.433110:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000172bc8e3 reply state 00000000c30f37a5 transno 8589957015 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.433129:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782487586.433139:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.433143:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.433147:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487586.433181:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55917aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1234:294620:x1869066294398208:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1196us (1338us total) trans 8589957015 rc 0/0 00000100:00100000:2.0:1782487586.433187:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27187 00010000:00010000:1.0:1782487586.433191:0:213491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.433192:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213850790149 time 7213853363785 state 0x2 ref 0 00010000:00010000:1.0:1782487586.433218:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433226:0:213491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.433245:0:213491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb18:0x0]: returning size 0 00000004:00200000:1.0:1782487586.433250:0:213491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.433264:0:213491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433272:0:213491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433277:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433282:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433286:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433293:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.433296:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433300:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433307:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.433310:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.433313:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433319:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e302 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433332:0:213491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433339:0:213491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433345:0:213491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433351:0:213491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.433355:0:213491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433362:0:213491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433377:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xa59895a8 (ffff9cb4c14c1000) 00010000:00010000:1.0:1782487586.433380:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.433383:0:213491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433388:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e309 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0xa59895a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433412:0:213491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e2fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 1234 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433422:0:213491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781a00/0x66475b4e8b85e310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d0 expref: 1233 pid: 213491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.433428:0:213491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb18:0x0].0x0 (ffff9cb4c14c1200) 00010000:00010000:1.0:1782487586.433430:0:213491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.433432:0:213491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db781a00, rc 0) 00000100:00100000:1.0:1782487586.433485:0:213491:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1233:2363:x1869066294398336:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 562us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.433494:0:213491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1164 00010000:00010000:2.0:1782487586.434423:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434439:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434456:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434462:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.434466:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434474:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434486:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7cebc0a8 (ffff9cb5517d5200) 00010000:00010000:2.0:1782487586.434490:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.434494:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.434501:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e2e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7cebc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.435101:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.435148:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294398592 00000100:00100000:2.0:1782487586.435155:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294398592 00000100:00100000:2.0:1782487586.435181:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213850790149 time 7213853363785 state 0x0 ref 1 00000100:00100000:2.0:1782487586.435192:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213853463785 time 7213853363785 state 0x1 ref 1 00000100:00100000:2.0:1782487586.435241:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213853463785 time 7213856631082 state 0x0 ref 1 00000100:00100000:2.0:1782487586.435255:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1232:294624:x1869066294398592:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.435304:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1782487586.435324:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f8a00/0x66475b4e8b85e118 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f7 expref: 1232 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435346:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb578deb000/0x66475b4e8b85df7b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478428 expref: 1231 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435368:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57976e800/0x66475b4e8b85ddb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783a3 expref: 1230 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435387:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85df27 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47839c expref: 1229 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435406:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85dcb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782fb expref: 1228 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435418:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb55880df00) 00010000:00010000:2.0:1782487586.435429:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.435452:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435464:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435473:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435488:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435496:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435503:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435631:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435640:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.435648:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.436146:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2559, 64 off171968 00010000:00010000:2.0:1782487586.436232:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436243:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436252:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436260:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436268:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436275:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436292:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.436306:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436311:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436315:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.436316:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436323:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.436325:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436326:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436341:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436342:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.436350:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436353:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb5517d5c00) 00010000:00010000:2.0:1782487586.436359:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.436363:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436365:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436369:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e325 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb13:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436385:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb13:0x0].0x0 (ffff9cb5517d5c00) 00010000:00010000:2.0:1782487586.436389:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436390:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.436396:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436397:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436412:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436414:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e32c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436419:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.436424:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436430:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436439:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.436440:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.436444:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.436445:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.436447:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.436452:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e317 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.436459:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1782487586.436461:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a48cfd16 reply state 0000000050e01b03 transno 8589957016 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.436470:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.436523:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5471d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1229:294624:x1869066294398592:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1271us (1425us total) trans 8589957016 rc 0/0 00000100:00100000:2.0:1782487586.436530:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27188 00000100:00100000:2.0:1782487586.436535:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213853463785 time 7213856631082 state 0x2 ref 0 00010000:00010000:2.0:1782487586.438980:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.438993:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439001:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439008:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.439014:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439022:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439036:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x8241c0a8 (ffff9cb5517d5300) 00010000:00010000:2.0:1782487586.439039:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.439044:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439050:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e31e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x8241c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.439360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.439411:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294398848 00000100:00100000:2.0:1782487586.439419:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294398848 00000100:00100000:2.0:1782487586.439447:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213853463785 time 7213856631082 state 0x0 ref 1 00000100:00100000:2.0:1782487586.439460:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213856731082 time 7213856631082 state 0x1 ref 1 00000100:00100000:2.0:1782487586.439489:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213856731082 time 7213860879030 state 0x0 ref 1 00000100:00100000:2.0:1782487586.439502:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1228:294618:x1869066294398848:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.439548:0:190299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.439566:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afa00/0x66475b4e8b85de6a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47835d expref: 1228 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439587:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4548c7600/0x66475b4e8b85da7a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478292 expref: 1227 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439601:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb44297d300) 00010000:00010000:2.0:1782487586.439646:0:190299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.439666:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439679:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439690:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439704:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439712:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439720:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439835:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439844:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.439853:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.440370:0:190299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2554, 64 off171648 00010000:00010000:2.0:1782487586.440450:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440462:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440472:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440480:0:190299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440487:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440494:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440520:0:190299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.440537:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440545:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440551:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440557:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.440561:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440569:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440579:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:3.0:1782487586.440581:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.440583:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.440590:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440591:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440631:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e341 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440642:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.440647:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440652:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440658:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440661:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440670:0:190286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0e:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:3.0:1782487586.440676:0:190286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.440679:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440680:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440699:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e348 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440703:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.440709:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440714:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.440718:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.440719:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.440721:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.440734:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.440738:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.440741:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.440749:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e333 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.440761:0:190299:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000429b5443 reply state 0000000078c17e6e transno 8589957017 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.440770:0:190299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.440838:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1228:294618:x1869066294398848:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1336us (1479us total) trans 8589957017 rc 0/0 00000100:00100000:2.0:1782487586.440848:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27189 00000100:00100000:2.0:1782487586.440854:0:190299:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213856731082 time 7213860879030 state 0x2 ref 0 00010000:00010000:2.0:1782487586.441771:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441785:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441792:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441798:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.441803:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441810:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441821:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x145c0a8 (ffff9cb5517d5200) 00010000:00010000:2.0:1782487586.441825:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.441829:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.441836:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e33a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x145c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.442288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.442344:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294399104 00000100:00100000:1.0:1782487586.442351:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294399104 00000100:00100000:1.0:1782487586.442382:0:213935:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213856731082 time 7213860879030 state 0x0 ref 1 00000100:00100000:1.0:1782487586.442393:0:213935:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213860979030 time 7213860879030 state 0x1 ref 1 00000100:00100000:1.0:1782487586.442420:0:213935:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213860979030 time 7213863810815 state 0x0 ref 1 00000100:00100000:1.0:1782487586.442432:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1227:294622:x1869066294399104:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:1.0:1782487586.442465:0:213935:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782487586.442480:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4d47f9200/0x66475b4e8b85e0e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783f0 expref: 1227 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442496:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb454f51c00/0x66475b4e8b85dd91 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478395 expref: 1226 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442510:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb44f587c00/0x66475b4e8b85df0b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47838e expref: 1225 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442528:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb5200/0x66475b4e8b85dc33 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782df expref: 1224 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442539:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c5187400) 00010000:00010000:1.0:1782487586.442549:0:213935:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.442565:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442574:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442581:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442593:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442629:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442638:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442717:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442725:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.442733:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782487586.443140:0:213935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2560, 64 off172032 00010000:00010000:1.0:1782487586.443220:0:213935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443231:0:213935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443239:0:213935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443247:0:213935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443254:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443260:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443282:0:213935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.443299:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443307:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.443307:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443313:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443314:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443321:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.443322:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487586.443326:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443326:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443335:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443335:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443353:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c14c1c00) 00010000:00010000:1.0:1782487586.443356:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487586.443360:0:191970:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb11:0x0].0x0 (ffff9cb4c14c1c00) 00010000:00010000:1.0:1782487586.443360:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443363:0:191970:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782487586.443367:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443367:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e35d lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443374:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e364 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443385:0:213935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443391:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.443391:0:213935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.443394:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487586.443397:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.443402:0:213935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443408:0:213935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.443412:0:213935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443419:0:213935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443427:0:213935:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.443429:0:213935:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.443431:0:213935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.443436:0:213935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e34f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.443444:0:213935:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f62d1215 reply state 0000000091df000f transno 8589957018 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.443450:0:213935:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.443503:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:294622:x1869066294399104:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1070us (1216us total) trans 8589957018 rc 0/0 00000100:00100000:1.0:1782487586.443512:0:213935:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27190 00000100:00100000:1.0:1782487586.443518:0:213935:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213860979030 time 7213863810815 state 0x2 ref 0 00010000:00010000:2.0:1782487586.444153:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444163:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444170:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444177:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.444181:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444188:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444209:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0xc91ac0a8 (ffff9cb4c14c1000) 00010000:00010000:2.0:1782487586.444213:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.444217:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444230:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e356 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0xc91ac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.444419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.444537:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294399232 00000100:00100000:2.0:1782487586.444543:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294399232 00000100:00100000:3.0:1782487586.444562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.444592:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1165 00000100:00100000:2.0:1782487586.444603:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1224:2362:x1869066294399232:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:1.0:1782487586.444644:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294399488 00000100:00100000:1.0:1782487586.444649:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294399488 00010000:00010000:2.0:1782487586.444657:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782487586.444669:0:190298:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213860979030 time 7213863810815 state 0x0 ref 1 00010000:00010000:2.0:1782487586.444670:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e36b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784d7 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.444686:0:190298:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213863910815 time 7213863810815 state 0x1 ref 1 00000100:00100000:1.0:1782487586.444710:0:190298:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213863910815 time 7213866100008 state 0x0 ref 1 00010000:00010000:2.0:1782487586.444716:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.444724:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1226:294619:x1869066294399488:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.444729:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444741:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444759:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444765:0:190298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782487586.444767:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444777:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444785:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb57fd88200/0x66475b4e8b85dd59 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478372 expref: 1226 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444807:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb548fb4000/0x66475b4e8b85daf1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782a0 expref: 1225 pid: 196437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444819:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb54b3dcc00) 00010000:00010000:1.0:1782487586.444828:0:190298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487586.444838:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444847:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444854:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444871:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444879:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444885:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444888:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444902:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444913:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782487586.444948:0:190302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb16:0x0]: returning size 0 00000004:00200000:2.0:1782487586.444953:0:190302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1782487586.444967:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.444972:0:190302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444975:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.444990:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.444993:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445004:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445011:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445024:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445031:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.445035:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445044:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445055:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:2.0:1782487586.445059:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.445063:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445070:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162200/0x66475b4e8b85e372 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445083:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445089:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445096:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445102:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.445107:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445120:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445130:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb5517d5300) 00010000:00010000:2.0:1782487586.445133:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.445137:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445144:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163400/0x66475b4e8b85e379 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445177:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163e00/0x66475b4e8b85e36b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 1225 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445193:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163a00/0x66475b4e8b85e38e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784d7 expref: 1224 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445212:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:2.0:1782487586.445216:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.445219:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4ca163a00, rc 0) 00000100:00100000:2.0:1782487586.445268:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1224:2362:x1869066294399232:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 667us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.445278:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1165 00000040:00080000:1.0:1782487586.445439:0:190298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2561, 64 off172096 00010000:00010000:1.0:1782487586.445510:0:190298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445518:0:190298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445523:0:190298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445528:0:190298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445533:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445537:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445551:0:190298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487586.445562:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445572:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487586.445573:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445577:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445579:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445585:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487586.445585:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.445589:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445589:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445597:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445598:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445642:0:190285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb541321600) 00010000:00010000:3.0:1782487586.445645:0:190285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782487586.445648:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb0f:0x0].0x0 (ffff9cb541321600) 00010000:00010000:3.0:1782487586.445650:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445651:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782487586.445654:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.445657:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780600/0x66475b4e8b85e39c lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445660:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781000/0x66475b4e8b85e395 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb0f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445682:0:190298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445689:0:190298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445695:0:190298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445701:0:190298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.445706:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.445706:0:190298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445712:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.445716:0:190298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.445717:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487586.445728:0:190298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.445732:0:190298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.445735:0:190298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.445741:0:190298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781c00/0x66475b4e8b85e380 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782487586.445751:0:190298:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e7751a reply state 0000000087dbb669 transno 8589957019 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487586.445757:0:190298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782487586.445796:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1225:294619:x1869066294399488:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1077us (1234us total) trans 8589957019 rc 0/0 00000100:00100000:1.0:1782487586.445805:0:190298:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27191 00000100:00100000:1.0:1782487586.445810:0:190298:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213863910815 time 7213866100008 state 0x2 ref 0 00010000:00010000:2.0:1782487586.446266:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446277:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446284:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446290:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.446294:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446301:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446313:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x68dcc0a8 (ffff9cb55a37b100) 00010000:00010000:2.0:1782487586.446316:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.446320:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.446326:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780000/0x66475b4e8b85e387 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x68dcc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.447138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.447175:0:213684:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294399744 00000100:00100000:2.0:1782487586.447182:0:213684:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294399744 00000100:00100000:2.0:1782487586.447212:0:213684:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213863910815 time 7213866100008 state 0x0 ref 1 00000100:00100000:2.0:1782487586.447222:0:213684:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213866200008 time 7213866100008 state 0x1 ref 1 00000100:00100000:2.0:1782487586.447246:0:213684:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213866200008 time 7213868636342 state 0x0 ref 1 00000100:00100000:2.0:1782487586.447258:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1224:294625:x1869066294399744:12345-192.168.202.21@tcp:36:rm.500 00010000:00010000:2.0:1782487586.447293:0:213684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:2.0:1782487586.447309:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4543a9e00/0x66475b4e8b85e16c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478405 expref: 1224 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447330:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a1ce1a00/0x66475b4e8b85e02a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478436 expref: 1223 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447349:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb464668a00/0x66475b4e8b85dfc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47833a expref: 1222 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447362:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb551446000/0x66475b4e8b85ddec lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783bf expref: 1221 pid: 190303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447375:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4a0a03a00/0x66475b4e8b85df97 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4783b8 expref: 1220 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447388:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54c4afc00/0x66475b4e8b85dce2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xb14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478309 expref: 1219 pid: 213218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447395:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb55880de00) 00010000:00010000:2.0:1782487586.447403:0:213684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487586.447413:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447420:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447426:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447438:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447461:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447469:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447552:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447561:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.447566:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782487586.447980:0:213684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2555, 64 off171712 00010000:00010000:2.0:1782487586.448051:0:213684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448060:0:213684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448068:0:213684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448076:0:213684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448082:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448089:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448108:0:213684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487586.448121:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448128:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448134:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448138:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487586.448141:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487586.448145:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448147:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448164:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487586.448166:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448170:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448178:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:2.0:1782487586.448184:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782487586.448190:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448193:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448213:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163000/0x66475b4e8b85e3b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xb14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448225:0:213229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb14:0x0].0x0 (ffff9cb5517d5b00) 00010000:00010000:3.0:1782487586.448230:0:213229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782487586.448231:0:213684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448235:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448247:0:213684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448250:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163600/0x66475b4e8b85e3b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xb14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448253:0:213684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448267:0:213684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.448271:0:213684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448276:0:213684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487586.448281:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.448284:0:213684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487586.448285:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.448288:0:213684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487586.448291:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487586.448292:0:213684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448297:0:213684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162000/0x66475b4e8b85e3a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.448306:0:213684:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000333ec3fb reply state 0000000016227221 transno 8589957020 ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.448310:0:213684:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782487586.448353:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294625:x1869066294399744:12345-192.168.202.21@tcp:36:rm.500 Request processed in 1098us (1216us total) trans 8589957020 rc 0/0 00000100:00100000:2.0:1782487586.448359:0:213684:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27192 00000100:00100000:2.0:1782487586.448363:0:213684:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213866200008 time 7213868636342 state 0x2 ref 0 00010000:00010000:2.0:1782487586.448969:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448980:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448987:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.448993:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.448998:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449003:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449011:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x7607c0a8 (ffff9cb5517d5200) 00010000:00010000:2.0:1782487586.449013:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.449016:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449020:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162a00/0x66475b4e8b85e3aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x35:0x0].0x7607c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.449157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.449189:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294399872 00000100:00100000:2.0:1782487586.449194:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294399872 00000100:00100000:2.0:1782487586.449221:0:190299:0:(nrs_tbf.c:1207:nrs_tbf_lru_tryhit()) mdt.0 NRS: TBF LRU hit: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213866200008 time 7213868636342 state 0x0 ref 1 00000100:00100000:3.0:1782487586.449222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487586.449232:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213868736342 time 7213868636342 state 0x1 ref 1 00000100:00100000:2.0:1782487586.449249:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400000 00000100:00100000:2.0:1782487586.449251:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400000 00000100:00100000:2.0:1782487586.449262:0:190299:0:(nrs_tbf.c:2372:nrs_tbf_req_add()) mdt.0 NRS: TBF enqueues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213868736342 time 7213868636342 state 0x1 ref 2 00000100:00100000:1.0:1782487586.449274:0:190296:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 2 deadline 7213870761564 time 7213870661564 state 0x1 ref 2 00000100:00100000:2.0:1782487586.449289:0:190299:0:(nrs_tbf.c:2296:nrs_tbf_req_get()) mdt.0 NRS: TBF dequeues: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213870761564 time 7213870677764 state 0x0 ref 2 00000100:00100000:1.0:1782487586.449290:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294637:x1869066294399872:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:1.0:1782487586.449305:0:190296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782487586.449316:0:190296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e3bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784de expref: -99 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487586.449322:0:190299:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1220:294638:x1869066294400000:12345-192.168.202.21@tcp:101:rm.500 00010000:00010000:2.0:1782487586.449339:0:190299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782487586.449351:0:190299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e3c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784e5 expref: -99 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449369:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449381:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449385:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449391:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449395:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449405:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449413:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449420:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449424:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449426:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487586.449440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487586.449443:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449446:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449538:0:190299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449548:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449551:0:190296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449566:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449574:0:190299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449575:0:190296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782487586.449634:0:190296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb16:0x0]: returning size 0 00000004:00200000:2.0:1782487586.449636:0:190299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd2:0xb17:0x0]: returning size 0 00000004:00200000:1.0:1782487586.449639:0:190296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00200000:2.0:1782487586.449642:0:190299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782487586.449657:0:190296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782487586.449661:0:190299:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449683:0:190296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449691:0:190299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449692:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449708:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449714:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449715:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449721:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449731:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449735:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.449741:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1782487586.449742:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449747:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449754:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449758:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449767:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.449770:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782487586.449773:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449778:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:1.0:1782487586.449778:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781400/0x66475b4e8b85e3cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449784:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.449788:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449793:0:190296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449798:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca162c00/0x66475b4e8b85e3d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449800:0:190296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449809:0:190296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449812:0:190299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449818:0:190296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.449820:0:190299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449825:0:190296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449827:0:190299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449846:0:190299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1782487586.449854:0:190299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449855:0:190296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449871:0:190299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449876:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x6fc4c0a8 (ffff9cb541321800) 00010000:00010000:1.0:1782487586.449881:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.449886:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x858dc0a8 (ffff9cb5517d5c00) 00010000:00010000:1.0:1782487586.449886:0:190296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449890:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782487586.449893:0:190299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449900:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb54834c800/0x66475b4e8b85e3e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x858dc0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449914:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781800/0x66475b4e8b85e3db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x6fc4c0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449941:0:190299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4ca163c00/0x66475b4e8b85e3c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 1224 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449960:0:190299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb558d86800/0x66475b4e8b85e3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784e5 expref: 1223 pid: 190299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.449960:0:190296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db780e00/0x66475b4e8b85e3bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784de expref: 1223 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487586.449979:0:190299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb17:0x0].0x0 (ffff9cb4a4c88900) 00010000:00010000:2.0:1782487586.449981:0:190299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782487586.449984:0:190299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb558d86800, rc 0) 00010000:00010000:1.0:1782487586.449993:0:190296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784de expref: 1222 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.450002:0:190296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:1.0:1782487586.450006:0:190296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782487586.450009:0:190296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4db781200, rc 0) 00000100:00100000:2.0:1782487586.450015:0:190299:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1222:294638:x1869066294400000:12345-192.168.202.21@tcp:101:rm.500 Request processed in 710us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.450021:0:190299:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27194 00000100:00100000:2.0:1782487586.450038:0:190299:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400128 00000100:00100000:1.0:1782487586.450039:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1221:294637:x1869066294399872:12345-192.168.202.21@tcp:101:rm.500 Request processed in 751us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487586.450042:0:190299:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400128 00000100:00100000:1.0:1782487586.450050:0:190296:0:(nrs_tbf.c:2427:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.202.21@tcp, seq: 27193 00000100:00100000:1.0:1782487586.450056:0:190296:0:(nrs_tbf.c:1187:nrs_tbf_lru_add()) mdt.0 NRS: TBF LRU add: class@ffff9cb45ae5be00 key uid={500} rule@0xffff9cb575f2ba00 gen 0 rate 10000 depth 3 token 1 deadline 7213870761564 time 7213870677764 state 0x2 ref 0 00000100:00100000:3.0:1782487586.451210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487586.451251:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400256 00000100:00100000:1.0:1782487586.451257:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400256 00000100:00100000:1.0:1782487586.451304:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1177 00000100:00100000:1.0:1782487586.451311:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1222:2362:x1869066294400256:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487586.451321:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487586.451332:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4db781200/0x66475b4e8b85e3f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784de expref: 1222 pid: 190296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487586.451345:0:190284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xb16:0x0].0x0 (ffff9cb55880d000) 00010000:00010000:1.0:1782487586.451349:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487586.451380:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+1221:2362:x1869066294400256:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487586.451388:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1177 00000004:00080000:2.0:1782487587.138433:0:190320:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7214559823843ns, next at 7215559821188ns, rc = 0 00000100:00100000:2.0:1782487587.138469:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299220992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782487587.138535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.138629:0:190932:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299220992 00000100:00100000:2.0:1782487587.138637:0:190932:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299220992 00000100:00100000:2.0:1782487587.138713:0:190932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1782487587.138724:0:190932:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb45a53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066299220992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782487587.138746:0:190932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3846176768 avail 3844079616 00000100:00100000:2.0:1782487587.138807:0:190932:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb45a53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066299220992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.138815:0:190932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1782487587.138841:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782487587.138883:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299220992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782487587.201698:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782487587.691309:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589956477 is committed 00000001:00080000:3.0:1782487587.691345:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589956461 is committed 00000001:00080000:3.0:1782487587.691410:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589957019 is committed 00000001:00080000:3.0:1782487587.691440:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589956989 is committed 00000004:00080000:3.0:1782487587.691467:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000100:00100000:2.0:1782487587.691692:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.691711:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299221120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.691775:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.691790:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299221632:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1782487587.691807:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 114 committed 00000100:00100000:0.0:1782487587.691829:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.691845:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299221504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.691854:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221120 00000100:00100000:1.0:1782487587.691862:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221120 00000100:00100000:2.0:1782487587.691875:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782487587.691888:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000100:00100000:1.0:1782487587.691907:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221632 00000100:00100000:2.0:1782487587.691908:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299222016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.691910:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221632 00000100:00100000:1.0:1782487587.691931:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221504 00000100:00100000:1.0:1782487587.691934:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221504 00000100:00100000:1.0:1782487587.691953:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16274 00000100:00100000:1.0:1782487587.691960:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3316:x1869066299221120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.691981:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6073 count 1 00000100:00100000:2.0:1782487587.691989:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.692001:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692023:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 116 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692026:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221248:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.692036:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b9:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.692040:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.692043:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782487587.692066:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 113 committed 00010000:00010000:1.0:1782487587.692066:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 116 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692070:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221760:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.692086:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 116 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.692102:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299222144:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.692114:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782487587.692121:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.692141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.692165:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.692174:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221888:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1782487587.692178:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782487587.692202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.692209:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299222016 00000100:00100000:1.0:1782487587.692213:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299222016 00000100:00100000:2.0:1782487587.692241:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221248 00000100:00100000:1.0:1782487587.692241:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221760 00000100:00100000:2.0:1782487587.692247:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221248 00000100:00100000:1.0:1782487587.692248:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221760 00000100:00100000:1.0:1782487587.692274:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221376 00000100:00100000:1.0:1782487587.692277:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221376 00000100:00100000:2.0:1782487587.692285:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299221888 00000100:00100000:2.0:1782487587.692290:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299221888 00000100:00100000:1.0:1782487587.692302:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16275 00000100:00100000:1.0:1782487587.692309:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299221632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.692320:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6068 count 1 00000100:00100000:2.0:1782487587.692326:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16276 00010000:00010000:1.0:1782487587.692330:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692337:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3316:x1869066299221504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.692343:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 134 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692348:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b4:0x0].0x0 since=6s v=(0 0) 00002000:00080000:2.0:1782487587.692350:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6069 count 1 00010000:00010000:1.0:1782487587.692351:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.692357:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692365:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692373:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 134 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692380:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 134 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692386:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 134 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692390:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.692398:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.692401:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692402:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299222272:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.692430:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 134 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692432:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.692441:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 134 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692451:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299222400:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.692454:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16277 00000100:00100000:1.0:1782487587.692463:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3316:x1869066299222016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.692474:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6071 count 1 00000004:00080000:3.0:1782487587.692476:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000100:00100000:2.0:1782487587.692479:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be180 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.692484:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692496:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 134 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692501:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b7:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.692504:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.692506:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692523:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 134 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692531:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 134 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692539:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299222656:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.692560:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.692579:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16278 00000100:00100000:1.0:1782487587.692587:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299221760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.692597:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6070 count 1 00010000:00010000:1.0:1782487587.692623:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692631:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 134 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692640:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b6:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.692642:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.692644:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692645:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16279 00000100:00100000:2.0:1782487587.692657:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299221248:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.692664:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 134 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.692670:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6066 count 1 00010000:00010000:1.0:1782487587.692673:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 134 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692682:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299223680:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.692683:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692694:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692699:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b2:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.692702:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.692705:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692712:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67d80 going to sleep for 11 seconds 00000004:00080000:3.0:1782487587.692723:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 115 committed 00010000:00010000:2.0:1782487587.692727:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692730:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16280 00000001:00080000:3.0:1782487587.692732:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589957020 is committed 00000100:00100000:1.0:1782487587.692741:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299221376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.692747:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.692752:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6067 count 1 00000100:00100000:2.0:1782487587.692764:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299223808:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.692765:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692777:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 134 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692781:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.692784:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.692786:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692796:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.692803:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 134 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.692810:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 134 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.692819:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299223936:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.692825:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16281 00000100:00100000:2.0:1782487587.692836:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299221888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.692838:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67900 going to sleep for 11 seconds 00002000:00080000:2.0:1782487587.692847:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6074 count 1 00010000:00010000:2.0:1782487587.692859:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692867:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692873:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.692875:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.692878:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692896:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.692908:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.692920:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299224064:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.692991:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.693026:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e5d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299222912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.693086:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299223424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.693128:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782487587.693134:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299222784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693153:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.693174:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299223296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.693213:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299222912 00000100:00100000:0.0:1782487587.693219:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299222912 00000100:00100000:2.0:1782487587.693253:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299223424 00000100:00100000:0.0:1782487587.693255:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299222784 00000100:00100000:1.0:1782487587.693257:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299223296 00000100:00100000:2.0:1782487587.693260:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299223424 00000100:00100000:0.0:1782487587.693260:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299222784 00000100:00100000:1.0:1782487587.693261:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299223296 00000100:00100000:0.0:1782487587.693292:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282 00000100:00100000:1.0:1782487587.693299:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16283 00000100:00100000:0.0:1782487587.693302:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3315:x1869066299222912:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693308:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16284 00000100:00100000:1.0:1782487587.693310:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3315:x1869066299222784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.693321:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6079 count 1 00000100:00100000:2.0:1782487587.693322:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3315:x1869066299223296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.693323:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6081 count 1 00010000:00010000:1.0:1782487587.693336:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.693340:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6090 count 1 00010000:00010000:0.0:1782487587.693340:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693353:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.693354:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693360:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693370:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c1:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782487587.693378:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.693383:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 141 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693385:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bf:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782487587.693386:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693395:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.693405:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.693414:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ca:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.693424:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.693432:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693445:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693450:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 141 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.693461:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 141 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693466:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 141 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693471:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 141 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.693485:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 141 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.693486:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00000100:00100000:0.0:1782487587.693496:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299224192:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.693504:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299224320:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.693513:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299224448:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.693527:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4436f7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.693538:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.693544:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.693565:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285 00000100:00100000:1.0:1782487587.693576:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3315:x1869066299223424:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.693589:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299222528:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.693590:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6091 count 1 00010000:00010000:1.0:1782487587.693623:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693637:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 141 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693645:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.693648:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.693655:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.693655:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.693682:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223168:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.693683:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 141 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.693695:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 112 committed 00010000:00010000:1.0:1782487587.693705:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 141 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.693715:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.693724:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299224576:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.693743:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782487587.693752:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e5d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.693769:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.693783:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.693796:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299222528 00000100:00100000:1.0:1782487587.693802:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299222528 00000100:00100000:2.0:1782487587.693809:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.693823:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299223168 00000100:00100000:0.0:1782487587.693828:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299223168 00000100:00100000:1.0:1782487587.693836:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299223040 00000100:00100000:2.0:1782487587.693839:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.693842:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299223040 00000100:00100000:0.0:1782487587.693863:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299223552 00000100:00100000:0.0:1782487587.693868:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299223552 00000100:00100000:1.0:1782487587.693879:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16286 00000100:00100000:2.0:1782487587.693889:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16287 00000100:00100000:1.0:1782487587.693891:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57651a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299222528:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.693897:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16288 00000100:00100000:2.0:1782487587.693902:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299223168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.693906:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6080 count 1 00000100:00100000:0.0:1782487587.693909:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299223040:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.693922:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.693923:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6083 count 1 00002000:00080000:0.0:1782487587.693925:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6082 count 1 00010000:00010000:1.0:1782487587.693942:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 141 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693942:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.693953:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693967:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c0:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1782487587.693970:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 156 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693975:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.693979:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 156 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.693985:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.693991:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 156 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.694006:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 141 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.694016:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.694019:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.694023:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.694026:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 141 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.694043:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00010000:00010000:1.0:1782487587.694052:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 141 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.694055:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 141 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.694082:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299224704:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.694086:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c2:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.694087:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 141 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.694093:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.694101:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.694110:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299224832:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.694110:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67180 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.694125:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 156 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.694138:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16289 00010000:00010000:0.0:1782487587.694139:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 156 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.694152:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 156 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.694154:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299223552:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.694155:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299224960:192.168.202.21@tcp:104: 00002000:00080000:1.0:1782487587.694173:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6084 count 1 00010000:00010000:2.0:1782487587.694179:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 156 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.694186:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.694206:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299225088:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.694208:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 156 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.694220:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 156 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.694226:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 156 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.694234:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c4:0x0].0x0 since=6s v=(0 0) 00000100:00100000:2.0:1782487587.694236:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.694243:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.694243:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299225216:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.694251:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.694270:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4436f7b40 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.694282:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 156 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.694293:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 156 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.694310:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299225344:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.694335:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67780 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.697040:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299222272:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.697064:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.697253:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299222144:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.697269:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.702855:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299223680:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.702856:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299223808:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.702876:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299223936:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.702891:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.702899:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.702899:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.702940:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299224064:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.702945:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299224320:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.702947:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299224192:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.702962:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.702965:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.702965:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703010:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299224576:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.703020:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299224448:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.703026:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703042:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.703046:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299224960:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.703057:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299224704:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.703066:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299225216:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.703085:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703086:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.703091:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299224832:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.703096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.703115:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299225088:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.703134:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299225344:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.703137:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.703156:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.703181:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400384 00000100:00100000:2.0:1782487587.703198:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400384 00000100:00100000:3.0:1782487587.703212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.703244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.703252:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 117 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703272:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400512 00000100:00100000:3.0:1782487587.703277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.703278:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400512 00000100:00100000:2.0:1782487587.703287:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401792 00000100:00100000:2.0:1782487587.703292:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401792 00010000:00010000:1.0:1782487587.703309:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 135 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703312:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 142 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.703344:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402304 00000100:00100000:2.0:1782487587.703345:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402048 00000100:00100000:3.0:1782487587.703350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.703350:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402304 00000100:00100000:2.0:1782487587.703352:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402048 00000100:00100000:3.0:1782487587.703373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.703377:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 158 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703378:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 158 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.703406:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400640 00000100:00100000:2.0:1782487587.703409:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400640 00000100:00100000:1.0:1782487587.703416:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400896 00010000:00010000:2.0:1782487587.703420:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 136 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703422:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400896 00000100:00100000:3.0:1782487587.703430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.703443:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401152 00010000:00010000:1.0:1782487587.703444:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.703447:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401152 00000100:00100000:3.0:1782487587.703458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.703461:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 143 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703470:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401408 00000100:00100000:2.0:1782487587.703476:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401664 00000100:00100000:1.0:1782487587.703476:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401408 00000100:00100000:2.0:1782487587.703481:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401664 00000100:00100000:3.0:1782487587.703485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.703495:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 145 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703497:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 145 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703511:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.703524:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402176 00000100:00100000:2.0:1782487587.703528:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402176 00000100:00100000:1.0:1782487587.703532:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294400768 00000100:00100000:3.0:1782487587.703536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.703538:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 159 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703538:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294400768 00000100:00100000:2.0:1782487587.703555:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401024 00000100:00100000:2.0:1782487587.703557:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401024 00010000:00010000:1.0:1782487587.703561:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 138 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782487587.703562:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487587.703565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00080000:0.0:1782487587.703568:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782487587.703572:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 118 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.703585:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401280 00000100:00100000:2.0:1782487587.703588:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401536 00000100:00100000:1.0:1782487587.703590:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401280 00000100:00100000:2.0:1782487587.703593:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401536 00010000:00010000:1.0:1782487587.703632:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 147 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703633:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 147 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.703659:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294401920 00000100:00100000:2.0:1782487587.703662:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294401920 00000100:00100000:1.0:1782487587.703670:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6154 00000100:00100000:0.0:1782487587.703671:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299222656:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.703673:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 160 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.703687:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+118:2361:x1869066294400384:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.703687:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.703693:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6155 00000100:00100000:2.0:1782487587.703704:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2361:x1869066294400512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.703705:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.703715:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.703715:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 118 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703725:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 138 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.703743:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 118 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703745:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 138 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703749:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402432 00000100:00100000:3.0:1782487587.703756:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402432 00010000:00010000:3.0:1782487587.703781:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 139 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703788:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dec1cde/0x66475b4e8b850c0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746cc expref: 118 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703789:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b8508c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474567 expref: 139 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703806:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402560 00000100:00100000:3.0:1782487587.703811:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402560 00010000:00010000:2.0:1782487587.703819:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.703820:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.703827:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.703828:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 139 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703829:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.703834:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703840:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.703855:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703880:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.703884:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6156 00010000:00010000:2.0:1782487587.703888:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.703894:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+147:2361:x1869066294401792:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.703902:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.703907:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 147 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.703912:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.703916:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 147 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.703929:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f8521c2/0x66475b4e8b84f1ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f1d expref: 147 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.703938:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+139:2361:x1869066294400512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 234us (802us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.703939:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.703941:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2361:x1869066294400384:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 260us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.703951:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6155 00000100:00100000:1.0:1782487587.703958:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6154 00000100:00100000:3.0:1782487587.703966:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+146:2361:x1869066294401792:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 72us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.703973:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6157 00000100:00100000:3.0:1782487587.703980:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6156 00000100:00100000:2.0:1782487587.703984:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+160:2361:x1869066294402048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.703991:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.703995:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 160 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.704000:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6158 00010000:00010000:2.0:1782487587.704014:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 160 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.704015:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+160:2361:x1869066294402304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.704032:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023086cc/0x66475b4e8b84ee10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473df0 expref: 160 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.704032:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.704041:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 160 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.704044:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.704050:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.704057:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.704064:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 159 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.704066:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.704093:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.704094:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b84eea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e0c expref: 159 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.704106:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.704109:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2361:x1869066294402048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 129us (866us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.704112:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.704119:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.704130:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.704148:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.704153:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704167:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.704169:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545577450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2361:x1869066294402304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (959us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.704196:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704203:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704218:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.704463:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+15:3317:x1869066299221632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12155us (12636us total) trans 8589940025 rc 0/0 00000100:00100000:0.0:1782487587.704470:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16275 00010000:00010000:0.0:1782487587.704488:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.704493:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704500:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.704504:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704511:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704520:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704527:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aa8cf1/0x66475b4e8b85e3fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.704542:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.704543:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.704544:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.708862:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6159 00000100:00100000:2.0:1782487587.708873:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6157 00000100:00100000:3.0:1782487587.708884:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2363:x1869066294400640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.708887:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6158 00010000:00010000:3.0:1782487587.708901:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.708911:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 138 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.708920:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6160 00010000:00010000:3.0:1782487587.708931:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 138 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.708938:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+138:2363:x1869066294400896:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.708953:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.708961:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 138 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.708964:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a41f79ab/0x66475b4e8b8508f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474575 expref: 138 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.708986:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.708989:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.708998:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.709004:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709008:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab01f1d5/0x66475b4e8b850491 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47445d expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709022:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709027:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709032:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709036:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.709039:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6161 00010000:00010000:3.0:1782487587.709048:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.709049:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.709055:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+145:2363:x1869066294401152:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.709071:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.709079:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 145 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.709085:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2363:x1869066294400640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 210us (5809us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.709087:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.709099:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 145 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709114:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2363:x1869066294400896:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 182us (5797us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.709117:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065d5e792/0x66475b4e8b84e932 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c5a expref: 145 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709129:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6160 00000100:00100000:3.0:1782487587.709139:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6159 00010000:00010000:1.0:1782487587.709139:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.709145:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.709151:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709154:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6162 00000100:00100000:3.0:1782487587.709166:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6163 00000100:00100000:0.0:1782487587.709168:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2363:x1869066294401664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.709179:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.709181:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+144:2363:x1869066294401408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.709202:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.709206:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.709211:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 144 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709216:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 144 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709219:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709231:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 144 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709246:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709247:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 144 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709257:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3801ffc/0x66475b4e8b84e92b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c53 expref: 144 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709274:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709283:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709291:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.709295:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709298:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709299:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004924f8e0/0x66475b4e8b84f388 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473f94 expref: 143 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709324:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.709328:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.709328:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.709328:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709339:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709359:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709371:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.709383:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.709395:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2363:x1869066294401664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 230us (6002us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.709403:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+142:2363:x1869066294401408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 226us (6029us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.709404:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6162 00000100:00100000:3.0:1782487587.709415:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6163 00000100:00100000:0.0:1782487587.709429:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6164 00000100:00100000:3.0:1782487587.709440:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6165 00000100:00100000:0.0:1782487587.709441:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+157:2363:x1869066294402176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.709452:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.709453:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2363:x1869066294400768:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.709460:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 157 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709464:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.709474:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709476:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 157 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709497:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709505:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c12c4eb/0x66475b4e8b84ee80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473dfe expref: 157 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709529:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.709534:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cce91c/0x66475b4e8b85048a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474456 expref: 134 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709547:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.709550:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545577c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+156:2363:x1869066294402176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (6124us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.709551:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.709556:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3314:x1869066299221376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16815us (17412us total) trans 8589940026 rc 0/0 00010000:00010000:3.0:1782487587.709559:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.709566:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16280 00010000:00010000:3.0:1782487587.709579:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709579:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6164 00010000:00010000:1.0:1782487587.709598:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709601:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.709603:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6166 00010000:00010000:1.0:1782487587.709636:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709636:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2363:x1869066294401024:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.709646:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2363:x1869066294400768:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (6189us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.709651:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.709662:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6165 00010000:00010000:1.0:1782487587.709664:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709664:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709683:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709690:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.709694:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6167 00010000:00010000:1.0:1782487587.709696:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487587.709706:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+140:2363:x1869066294401536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.709714:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fce295d/0x66475b4e8b850e8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47472e expref: 116 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709715:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.709726:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 140 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709730:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709736:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709742:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709743:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 140 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709762:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709786:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d07f3f3/0x66475b4e8b84f3d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473fb0 expref: 140 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709794:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.709798:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.709803:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.709808:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.709817:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2363:x1869066294401024:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 182us (6332us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.709820:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.709831:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3317:x1869066299223552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15675us (15986us total) trans 8589940688 rc 0/0 00000100:00100000:0.0:1782487587.709832:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6166 00000100:00100000:1.0:1782487587.709843:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16289 00010000:00010000:3.0:1782487587.709848:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.709854:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6168 00000100:00100000:0.0:1782487587.709864:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+139:2363:x1869066294401280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.709869:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+139:2363:x1869066294401536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (6333us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.709870:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487587.709875:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.709882:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6167 00010000:00010000:1.0:1782487587.709882:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709884:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 139 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.709902:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6169 00010000:00010000:1.0:1782487587.709908:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781c00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.709916:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2363:x1869066294401920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.709917:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709923:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 138 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709928:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.709937:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 155 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709941:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709953:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9918363/0x66475b4e8b84e940 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473c61 expref: 138 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.709965:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 155 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709970:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.709974:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709983:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.709993:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.709997:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007725fb41/0x66475b4e8b85e421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.710007:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a489204d/0x66475b4e8b84eedb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e21 expref: 155 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.710015:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710032:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.710033:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.710037:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.710038:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.710045:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.710047:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710052:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.710058:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.710060:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.710065:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2363:x1869066294401280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (6557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.710083:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6168 00010000:00010000:1.0:1782487587.710084:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.710096:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.710099:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.710108:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6170 00010000:00010000:1.0:1782487587.710109:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032448be9/0x66475b4e8b85e460 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.710115:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+154:2363:x1869066294401920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.710123:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2362:x1869066294402432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.710130:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6169 00010000:00010000:1.0:1782487587.710130:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.710135:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.710136:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.710139:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.710145:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 132 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.710151:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6171 00010000:00010000:1.0:1782487587.710152:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.710165:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545575850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2362:x1869066294402560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.710176:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.710179:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.710185:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 132 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.710212:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.710213:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.710219:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.710227:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710229:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.710240:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710252:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.710254:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.710269:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2362:x1869066294402432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 152us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.710274:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6170 00000100:00100000:1.0:1782487587.710408:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57651a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3317:x1869066299222528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16521us (16756us total) trans 8589940689 rc 0/0 00000100:00100000:1.0:1782487587.710415:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16286 00010000:00010000:1.0:1782487587.710445:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710455:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710462:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710469:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710487:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.710674:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+15:3315:x1869066299223424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17101us (17566us total) trans 8589940690 rc 0/0 00000100:00100000:1.0:1782487587.710682:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285 00010000:00010000:1.0:1782487587.710706:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710712:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710718:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710722:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710733:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.710854:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3315:x1869066299222784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17548us (17701us total) trans 8589940691 rc 0/0 00000100:00100000:1.0:1782487587.710859:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16283 00010000:00010000:1.0:1782487587.710879:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.710885:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710893:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.710897:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710906:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710920:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710926:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089bd0bd/0x66475b4e8b85e44b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710940:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.710942:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710946:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db780800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.710949:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710954:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710962:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710966:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a1deb6/0x66475b4e8b85e444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710980:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.710982:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710987:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.710990:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.710995:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711002:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711007:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e4ebd0/0x66475b4e8b85e42f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711019:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.711021:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.711023:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.711031:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.711063:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491ace00/2, rc 0, transno 8589940691 00000100:00100000:1.0:1782487587.711075:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299222784:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.711088:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c48a80/2, rc 0, transno 8589940690 00000100:00100000:1.0:1782487587.711092:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299223424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.711162:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.711173:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299225472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.711217:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.711259:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299225472 00000100:00100000:1.0:1782487587.711265:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299225472 00000100:00100000:1.0:1782487587.711301:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16290 00000100:00100000:1.0:1782487587.711310:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299225472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.711330:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6085 count 1 00010000:00010000:1.0:1782487587.711348:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711362:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 153 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711369:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.711373:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.711378:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711400:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 152 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711411:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 152 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.711416:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082c7db0c/0x66475b4e8b8508ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47456e expref: 131 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.711424:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299225728:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.711428:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299222400:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.711451:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.711465:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.711467:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67240 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.711473:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711494:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.711495:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.711504:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711509:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711518:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.711519:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.711526:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711538:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.711718:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3316:x1869066299221504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19383us (19842us total) trans 8589940028 rc 0/0 00000100:00100000:1.0:1782487587.711718:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3316:x1869066299221120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19756us (19942us total) trans 8589940027 rc 0/0 00000100:00100000:1.0:1782487587.711726:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16274 00010000:00010000:1.0:1782487587.711750:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.711755:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711769:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.711772:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 130 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711775:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.711787:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16276 00010000:00010000:1.0:1782487587.711798:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.711805:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 130 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711816:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711826:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.711830:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546d9a680/2, rc 0, transno 8589940688 00010000:00010000:3.0:1782487587.711831:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b850a64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745fa expref: 130 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.711843:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.711849:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.711853:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.711854:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.711858:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.711859:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491ac700/2, rc 0, transno 8589940689 00010000:00010000:3.0:1782487587.711861:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.711866:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299222528:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.711874:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.711879:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711879:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.711887:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c09c00/2, rc 0, transno 8589940025 00000100:00100000:2.0:1782487587.711900:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299221632:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.711901:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711913:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711920:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b56d3680/0x66475b4e8b85e3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.711922:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.711923:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299225600:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.711927:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711936:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.711938:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.711940:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.711944:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.711948:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545575850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2362:x1869066294402560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1783us (8222us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.711954:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.711957:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.711965:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6171 00010000:00010000:0.0:1782487587.711973:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.711987:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c0b800/2, rc 0, transno 8589940026 00000100:00100000:1.0:1782487587.711991:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.711993:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.711993:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.712001:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299225984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.712005:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.712011:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299225856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.712035:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.712063:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299226112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.712078:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299225600 00000100:00100000:2.0:1782487587.712081:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299225600 00010000:00010000:3.0:1782487587.712084:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.712091:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.712092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.712103:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.712107:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.712111:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299225984 00000100:00100000:2.0:1782487587.712116:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299225984 00010000:00010000:3.0:1782487587.712118:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.712137:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.712140:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299226112 00000100:00100000:2.0:1782487587.712144:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16291 00000100:00100000:1.0:1782487587.712145:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299226112 00010000:00010000:3.0:1782487587.712147:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f4c744/0x66475b4e8b85e40c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.712150:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299222016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19686us (20160us total) trans 8589940029 rc 0/0 00000100:00100000:2.0:1782487587.712158:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3314:x1869066299225600:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.712165:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16277 00000100:00100000:1.0:1782487587.712178:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16292 00002000:00080000:2.0:1782487587.712179:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6086 count 1 00010000:00010000:3.0:1782487587.712183:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.712199:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.712199:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3317:x1869066299225984:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.712203:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.712204:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.712212:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6089 count 1 00010000:00010000:2.0:1782487587.712217:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 152 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712222:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.712224:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c6:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.712227:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.712230:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712233:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 152 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712240:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c9:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.712242:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.712246:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.712248:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 152 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.712258:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 152 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712262:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 152 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.712269:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299226368:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.712271:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 152 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.712279:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299226496:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.712496:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.712517:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.712525:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299226240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.712546:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.712577:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299225856 00000100:00100000:0.0:1782487587.712581:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299225856 00000100:00100000:1.0:1782487587.712652:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299226240 00000100:00100000:1.0:1782487587.712657:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299226240 00000100:00100000:1.0:1782487587.712683:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16293 00000100:00100000:1.0:1782487587.712689:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3317:x1869066299226112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.712700:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6075 count 1 00010000:00010000:1.0:1782487587.712711:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712721:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 114 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712727:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.712729:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.712732:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712748:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 114 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.712755:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 114 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.712763:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299226624:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.712912:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c0b480/2, rc 0, transno 8589940028 00000100:00100000:1.0:1782487587.712922:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299221504:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.712932:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c08000/2, rc 0, transno 8589940029 00000100:00100000:1.0:1782487587.712936:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299222016:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.712944:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c0a300/2, rc 0, transno 8589940027 00000100:00100000:1.0:1782487587.712947:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299221120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.712990:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299227008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.713009:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.713027:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.713036:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299226880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.713054:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.713067:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299227008 00000100:00100000:1.0:1782487587.713070:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299227008 00000100:00100000:1.0:1782487587.713084:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299226880 00000100:00100000:1.0:1782487587.713087:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299226880 00000100:00100000:1.0:1782487587.713099:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16294 00000100:00100000:1.0:1782487587.713104:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3314:x1869066299225856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.713114:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6088 count 1 00010000:00010000:1.0:1782487587.713125:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713135:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 152 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713141:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c8:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.713144:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.713147:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713162:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 152 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713171:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 152 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.713180:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299227136:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.713215:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.713226:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16295 00000100:00100000:1.0:1782487587.713233:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3315:x1869066299226240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.713243:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6079 count 1 00010000:00010000:1.0:1782487587.713255:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713265:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 114 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713271:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bf:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.713274:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.713277:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713299:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 114 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713308:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 114 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.713316:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299227264:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.713343:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16296 00000100:00100000:1.0:1782487587.713350:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3317:x1869066299227008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.713361:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6077 count 1 00010000:00010000:1.0:1782487587.713371:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713382:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 114 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713388:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.713391:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.713394:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713411:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 114 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713424:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 114 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.713433:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299227392:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.713490:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.713502:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16297 00000100:00100000:1.0:1782487587.713510:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3316:x1869066299226880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.713520:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6078 count 1 00010000:00010000:1.0:1782487587.713530:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713541:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 114 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713547:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.713550:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.713553:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713567:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 114 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.713575:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 114 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.713589:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299227520:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.713667:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.714172:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.714184:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.714200:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.714200:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714211:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714220:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714228:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714246:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.714352:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.714362:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.714371:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.714379:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.714393:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.714422:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.714431:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.714450:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.714467:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3315:x1869066299222912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21166us (21400us total) trans 8589940692 rc 0/0 00000100:00100000:1.0:1782487587.714476:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282 00010000:00010000:1.0:1782487587.714505:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.714512:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714520:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.714525:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714536:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714550:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714559:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714583:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.714587:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714594:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.714598:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714625:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714638:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714646:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e43d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714669:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.714674:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714681:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4db781400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.714685:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714694:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714706:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.714714:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b3ec64/0x66475b4e8b85e413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.714727:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+19:3315:x1869066299223296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21409us (21524us total) trans 8589940693 rc 0/0 00010000:00010000:1.0:1782487587.714732:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.714735:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16284 00010000:00010000:1.0:1782487587.714735:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.714739:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3314:x1869066299221760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22153us (22646us total) trans 8589940030 rc 0/0 00010000:00010000:1.0:1782487587.714739:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.714747:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16278 00010000:00010000:2.0:1782487587.714764:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.714773:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c09180/2, rc 0, transno 8589940030 00010000:00010000:2.0:1782487587.714774:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.714785:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221760:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.714787:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.714787:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.714791:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782487587.714796:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.714801:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299226752:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.714810:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.714832:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.714911:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299227648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.714946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.715006:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c48380/2, rc 0, transno 8589940693 00000100:00100000:1.0:1782487587.715017:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299223296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.715018:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+19:3314:x1869066299221888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22185us (22816us total) trans 8589940031 rc 0/0 00000100:00100000:2.0:1782487587.715026:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16281 00000004:00080000:1.0:1782487587.715032:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e5d54000/2, rc 0, transno 8589940692 00000100:00100000:1.0:1782487587.715037:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e5d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299222912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.715044:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299226752 00000100:00100000:2.0:1782487587.715048:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299226752 00000100:00100000:2.0:1782487587.715076:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299227648 00000100:00100000:2.0:1782487587.715080:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299227648 00000100:00100000:2.0:1782487587.715104:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16298 00000100:00100000:2.0:1782487587.715111:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:3314:x1869066299226752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.715125:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6076 count 1 00000100:00100000:1.0:1782487587.715130:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.715137:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299227904:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.715138:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.715150:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 114 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.715158:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.715162:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.715164:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.715167:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715225:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.715231:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715239:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.715243:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715253:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715266:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715274:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715299:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.715300:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 114 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715302:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.715305:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.715314:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 114 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.715327:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299228032:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.715330:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c08700/2, rc 0, transno 8589940031 00000100:00100000:1.0:1782487587.715340:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.715348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.715357:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299227776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.715369:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.715382:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.715402:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299227904 00000100:00100000:2.0:1782487587.715405:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299227904 00000100:00100000:2.0:1782487587.715431:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299227776 00000100:00100000:2.0:1782487587.715434:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299227776 00000100:00100000:1.0:1782487587.715445:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.715453:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299228160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.715465:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16299 00000100:00100000:2.0:1782487587.715473:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3314:x1869066299227648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.715481:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.715534:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1782487587.715547:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6080 count 1 00000100:00100000:1.0:1782487587.715547:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299228160 00000100:00100000:1.0:1782487587.715551:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299228160 00010000:00010000:2.0:1782487587.715560:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.715573:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 114 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715573:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16300 00010000:00010000:2.0:1782487587.715581:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c0:0x0].0x0 since=6s v=(0 0) 00000100:00100000:1.0:1782487587.715581:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3317:x1869066299227904:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.715585:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.715590:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.715593:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6092 count 1 00010000:00010000:2.0:1782487587.715632:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 114 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715636:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.715643:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 114 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715648:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 152 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.715655:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299228288:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.715655:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cc:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.715659:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.715664:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715683:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 152 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715693:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 152 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.715695:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.715704:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299228416:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.715716:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16301 00000100:00100000:2.0:1782487587.715725:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+20:3314:x1869066299227776:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.715726:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00002000:00080000:2.0:1782487587.715738:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6087 count 1 00000100:00100000:1.0:1782487587.715747:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67180 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.715751:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.715763:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 152 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715766:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.715771:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c7:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.715774:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.715778:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715784:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67900 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.715799:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 152 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715802:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.715814:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 152 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715818:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67840 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.715826:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299228544:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.715831:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67300 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.715849:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.715851:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16302 00000100:00100000:1.0:1782487587.715860:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3316:x1869066299228160:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.715868:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.715872:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6081 count 1 00010000:00010000:2.0:1782487587.715877:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715885:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715897:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 114 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715904:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.715908:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.715912:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715932:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 114 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.715942:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 114 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.715954:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299228672:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.715978:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.716007:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2363:x1869066294401152:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 6956us (12659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.716017:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6161 00010000:00010000:1.0:1782487587.716117:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.716128:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.716138:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.716146:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.716167:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.716330:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+21:3317:x1869066299223040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22425us (22548us total) trans 8589940694 rc 0/0 00000100:00100000:1.0:1782487587.716338:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16288 00000004:00080000:1.0:1782487587.716369:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e5d57100/2, rc 0, transno 8589940694 00000100:00100000:1.0:1782487587.716379:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e5d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.716434:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.716442:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299228800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.716467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.716495:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.716499:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299228800 00010000:00010000:1.0:1782487587.716501:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.716506:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299228800 00010000:00010000:1.0:1782487587.716514:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.716518:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.716527:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.716538:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16303 00010000:00010000:1.0:1782487587.716541:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.716549:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3315:x1869066299228800:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.716553:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.716565:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6095 count 1 00010000:00010000:1.0:1782487587.716575:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.716579:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.716581:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.716581:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.716599:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 135 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.716631:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cf:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.716635:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.716640:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.716662:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 135 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.716674:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 135 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.716686:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299228928:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.716695:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.716704:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.716711:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.716716:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.716721:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4436f7cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.716729:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.716875:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3314:x1869066299221248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24219us (24819us total) trans 8589940032 rc 0/0 00000100:00100000:3.0:1782487587.716884:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16279 00000004:00080000:0.0:1782487587.716909:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb476c0bb80/2, rc 0, transno 8589940032 00000100:00100000:0.0:1782487587.716928:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299221248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.716979:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.717013:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.717039:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229056 00000100:00100000:1.0:1782487587.717044:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229056 00010000:00010000:3.0:1782487587.717054:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.717058:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.717064:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.717067:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.717073:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.717074:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16304 00000100:00100000:1.0:1782487587.717086:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+22:3315:x1869066299229056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.717099:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6083 count 1 00010000:00010000:1.0:1782487587.717110:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.717122:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 128 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.717131:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1782487587.717133:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.717135:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.717144:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.717146:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e6fc32b/0x66475b4e8b85e41a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.717175:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.717178:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.717179:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 128 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.717181:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.717207:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 128 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.717223:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299229184:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.717536:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.717548:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.717567:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.717591:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.717596:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.717604:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.717623:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.717631:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.717643:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.717651:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002713c970/0x66475b4e8b85e459 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.717665:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.717667:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.717668:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.717832:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3317:x1869066299223168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23933us (24119us total) trans 8589940695 rc 0/0 00000100:00100000:2.0:1782487587.717841:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16287 00000004:00080000:0.0:1782487587.717857:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548e7ca80/2, rc 0, transno 8589940695 00000100:00100000:0.0:1782487587.717869:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299223168:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.718752:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5412ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.718816:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299229312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.718851:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.718877:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229312 00000100:00100000:2.0:1782487587.718883:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229312 00000100:00100000:2.0:1782487587.718934:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16305 00000100:00100000:2.0:1782487587.718943:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3316:x1869066299229312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.718960:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6094 count 1 00010000:00010000:2.0:1782487587.718974:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.718988:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 152 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.718995:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ce:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.718999:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.719003:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.719024:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 152 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.719035:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 152 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.719047:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299229440:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.719085:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be540 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.719325:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299227520:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.719348:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.719390:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299228032:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.719410:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.720835:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299226368:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.720855:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.720890:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299225728:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.720906:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.720936:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299226496:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.720958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.720958:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.720969:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299226624:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.720986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.720994:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721013:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402816 00000100:00100000:2.0:1782487587.721018:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402816 00000100:00100000:0.0:1782487587.721024:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402688 00000100:00100000:0.0:1782487587.721030:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402688 00000100:00100000:3.0:1782487587.721035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.721039:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299227136:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.721043:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 116 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721052:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 116 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721057:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721078:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403200 00000100:00100000:3.0:1782487587.721084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.721084:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403200 00000100:00100000:0.0:1782487587.721096:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294402944 00000100:00100000:1.0:1782487587.721100:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299227264:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.721102:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294402944 00010000:00010000:2.0:1782487587.721104:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 153 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.721118:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721124:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 154 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721130:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403072 00000100:00100000:2.0:1782487587.721136:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403072 00000100:00100000:3.0:1782487587.721149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.721156:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403328 00010000:00010000:2.0:1782487587.721158:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 155 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.721159:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299227392:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.721160:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403328 00010000:00010000:1.0:1782487587.721179:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721181:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 117 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721198:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6172 00000100:00100000:2.0:1782487587.721223:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294402816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.721231:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6173 00010000:00010000:2.0:1782487587.721236:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.721240:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299228416:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.721241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.721242:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294402688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.721246:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 117 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721257:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.721263:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721264:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 117 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721265:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 117 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.721295:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 117 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.721312:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299228672:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.721319:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004421972c/0x66475b4e8b8511d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47481c expref: 117 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.721329:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721342:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.721344:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721344:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b8511e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474831 expref: 116 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721351:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.721359:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721360:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.721364:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403456 00000100:00100000:3.0:1782487587.721365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.721367:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17be:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.721371:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403456 00010000:00010000:0.0:1782487587.721375:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721379:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721382:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721395:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 156 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.721411:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.721420:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403712 00000100:00100000:3.0:1782487587.721425:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403712 00010000:00010000:0.0:1782487587.721427:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.721429:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403584 00000100:00100000:1.0:1782487587.721434:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403584 00010000:00010000:1.0:1782487587.721453:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 117 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721458:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 117 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721459:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294402816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 239us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.721460:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294402688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 218us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.721481:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6172 00000100:00100000:0.0:1782487587.721492:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6173 00000100:00100000:2.0:1782487587.721505:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404096 00000100:00100000:1.0:1782487587.721508:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404224 00000100:00100000:2.0:1782487587.721511:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404096 00000100:00100000:0.0:1782487587.721513:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403840 00000100:00100000:1.0:1782487587.721514:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404224 00000100:00100000:0.0:1782487587.721520:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403840 00010000:00010000:2.0:1782487587.721530:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 158 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721536:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 116 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721541:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 158 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721558:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6174 00000100:00100000:2.0:1782487587.721570:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2360:x1869066294403200:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.721579:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.721579:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6175 00010000:00010000:2.0:1782487587.721587:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 158 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.721589:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6176 00000100:00100000:1.0:1782487587.721593:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2360:x1869066294402944:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.721602:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6177 00000100:00100000:0.0:1782487587.721627:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+158:2360:x1869066294403072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.721638:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 158 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721641:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.721643:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2360:x1869066294403328:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.721652:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 158 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721658:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.721665:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2dde69a/0x66475b4e8b84f5e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474051 expref: 158 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721668:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 116 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721672:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 158 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721674:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.721685:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 158 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721688:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.721699:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 116 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721700:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721711:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3a4ca9/0x66475b4e8b84f5a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474027 expref: 157 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721713:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721713:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 157 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721737:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721740:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.721748:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1f10b3/0x66475b4e8b84effa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a473e75 expref: 156 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721748:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721759:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721768:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721769:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb46a112/0x66475b4e8b8510ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4747a5 expref: 116 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721771:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.721775:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.721781:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.721791:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721794:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721798:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.721805:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.721805:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.721811:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2360:x1869066294403200:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 241us (772us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.721816:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.721827:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+155:2360:x1869066294403072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 224us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.721831:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6174 00010000:00010000:1.0:1782487587.721836:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.721838:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.721844:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6176 00000100:00100000:2.0:1782487587.721855:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6178 00010000:00010000:1.0:1782487587.721861:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.721865:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6179 00000100:00100000:2.0:1782487587.721871:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+153:2361:x1869066294403456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.721879:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.721879:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2361:x1869066294403584:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.721884:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.721890:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.721893:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 153 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721896:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721899:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 115 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721925:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 115 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.721932:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.721933:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.721933:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 153 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721940:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c822479/0x66475b4e8b8513a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748b6 expref: 115 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721957:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007445b45a/0x66475b4e8b84f5db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47403c expref: 153 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.721959:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721967:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721975:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.721979:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.721987:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.721990:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.721993:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2360:x1869066294403328:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 325us (810us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.721993:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.722007:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6177 00010000:00010000:2.0:1782487587.722009:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722009:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.722030:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+113:2361:x1869066294403584:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 156us (716us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.722032:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.722039:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6179 00000100:00100000:0.0:1782487587.722056:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6180 00000100:00100000:2.0:1782487587.722060:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545574050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+152:2361:x1869066294403456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.722066:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2360:x1869066294403712:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.722071:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6178 00010000:00010000:0.0:1782487587.722074:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.722079:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 112 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722089:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 112 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.722096:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6181 00010000:00010000:0.0:1782487587.722103:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ea9254/0x66475b4e8b85138d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47489a expref: 112 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.722104:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6182 00000100:00100000:2.0:1782487587.722109:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2361:x1869066294404096:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.722117:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.722120:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.722121:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.722127:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722129:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 151 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722151:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.722162:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3317:x1869066299225984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9975us (10123us total) trans 8589940696 rc 0/0 00010000:00010000:2.0:1782487587.722167:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 151 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722172:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.722177:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16292 00000100:00100000:3.0:1782487587.722184:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294404224:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.722201:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.722206:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.722209:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.722210:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722216:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2360:x1869066294403712:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 152us (930us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.722223:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722229:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6180 00010000:00010000:2.0:1782487587.722243:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.722250:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6183 00010000:00010000:3.0:1782487587.722255:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 110 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722261:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2362:x1869066294403840:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.722265:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+151:2361:x1869066294404096:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (924us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.722276:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.722281:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6181 00010000:00010000:3.0:1782487587.722282:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 110 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722286:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 151 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722306:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 150 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722309:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003480b4bc/0x66475b4e8b851523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47491f expref: 110 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.722319:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299228288:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.722333:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e333a825/0x66475b4e8b84f7a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4740ba expref: 150 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722336:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.722339:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722344:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.722355:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722360:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.722367:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722367:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.722375:0:213693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7eeea18/0x66475b4e8b84f5d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47402e expref: 149 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722378:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.722399:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299228544:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.722411:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722414:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722429:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722436:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722436:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.722447:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722455:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722457:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2362:x1869066294403840:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 198us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.722472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.722475:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6183 00010000:00010000:2.0:1782487587.722479:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.722504:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722514:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722525:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722533:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722550:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1782487587.722633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.722681:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+24:3314:x1869066299227776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6958us (7297us total) trans 8589940697 rc 0/0 00000100:00100000:2.0:1782487587.722690:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16301 00010000:00010000:2.0:1782487587.722714:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722722:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722730:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722742:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722759:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1782487587.722764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.722774:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+23:3317:x1869066299226112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10084us (10682us total) trans 8589940033 rc 0/0 00000100:00100000:0.0:1782487587.722780:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16293 00000100:00100000:3.0:1782487587.722794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.722808:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294403968 00000100:00100000:0.0:1782487587.722813:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294403968 00010000:00010000:0.0:1782487587.722832:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 110 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722839:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782487587.722844:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722851:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404352 00010000:00010000:3.0:1782487587.722852:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.722856:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404352 00010000:00010000:3.0:1782487587.722857:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722866:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722876:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.722878:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 136 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722884:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f08a7a12/0x66475b4e8b85e475 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722901:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404480 00000100:00100000:0.0:1782487587.722905:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404480 00010000:00010000:3.0:1782487587.722910:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1782487587.722910:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+23:3314:x1869066299226752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7799us (8078us total) trans 8589940034 rc 0/0 00010000:00010000:3.0:1782487587.722917:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.722921:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16298 00010000:00010000:0.0:1782487587.722922:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 129 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722937:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.722941:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722943:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722948:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404608 00010000:00010000:3.0:1782487587.722954:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722954:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404608 00010000:00010000:2.0:1782487587.722956:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.722966:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487587.722970:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 148 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.722977:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.722977:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.722978:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.722998:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6184 00010000:00010000:3.0:1782487587.723004:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf9a67dd/0x66475b4e8b85e4b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723005:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.723007:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1a00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.723014:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2362:x1869066294403968:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.723015:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723030:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.723032:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.723034:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723035:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487587.723040:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 110 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723043:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.723057:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723067:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.723071:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075dafd13/0x66475b4e8b85e47c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723072:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 110 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723074:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723100:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.723105:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.723112:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723114:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3151709/0x66475b4e8b85150e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474911 expref: 110 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723117:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723126:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3314:x1869066299225600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10971us (11170us total) trans 8589940698 rc 0/0 00010000:00010000:3.0:1782487587.723144:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039bcf9a4/0x66475b4e8b85e49f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723144:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16291 00010000:00010000:0.0:1782487587.723146:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.723152:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.723157:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.723159:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723165:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723172:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.723172:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723173:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299229440:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.723176:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.723180:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.723183:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.723212:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723215:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723216:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.723223:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.723231:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000638466c8/0x66475b4e8b85e46e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723244:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.723248:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2361:x1869066294404224:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1069us (1887us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.723250:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.723255:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2362:x1869066294403968:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 242us (782us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.723256:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.723260:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6182 00010000:00010000:1.0:1782487587.723260:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.723271:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6185 00000100:00100000:0.0:1782487587.723279:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6184 00000100:00100000:2.0:1782487587.723284:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2362:x1869066294404352:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.723294:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1782487587.723294:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549183100/2, rc 0, transno 8589940033 00010000:00010000:2.0:1782487587.723304:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 136 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.723304:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6186 00000100:00100000:1.0:1782487587.723309:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299226112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.723320:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066294404480:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.723328:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 136 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.723332:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df7100/2, rc 0, transno 8589940696 00010000:00010000:0.0:1782487587.723333:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.723343:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6187 00010000:00010000:0.0:1782487587.723343:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 129 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723347:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299225984:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.723349:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.723358:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+148:2360:x1869066294404608:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.723359:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.723369:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.723370:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.723370:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 129 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.723384:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c45880/2, rc 0, transno 8589940697 00010000:00010000:2.0:1782487587.723391:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723394:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299227776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.723411:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1782487587.723413:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df5880/2, rc 0, transno 8589940034 00010000:00010000:2.0:1782487587.723419:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.723420:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 148 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723420:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.723422:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299226752:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.723430:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.723439:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.723441:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df4000/2, rc 0, transno 8589940698 00010000:00010000:3.0:1782487587.723443:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 148 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723448:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545576850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2362:x1869066294404352:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.723451:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299225600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.723466:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6185 00010000:00010000:0.0:1782487587.723466:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723474:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001af0e066/0x66475b4e8b84fba7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741c4 expref: 148 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723487:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.723490:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.723491:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.723494:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723505:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723507:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.723518:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066294404480:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (752us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.723525:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.723533:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6186 00010000:00010000:2.0:1782487587.723537:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723547:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723563:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723564:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.723576:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723583:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299229568:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.723586:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.723596:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723642:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.723645:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.723671:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299230080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.723674:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.723679:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723688:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca163e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.723692:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723698:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723703:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.723736:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.723745:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299229952:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.723747:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723755:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044476fd1/0x66475b4e8b85e4a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723765:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3314:x1869066299227648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8292us (8819us total) trans 8589940035 rc 0/0 00010000:00010000:3.0:1782487587.723771:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.723772:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16299 00010000:00010000:3.0:1782487587.723775:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723784:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.723787:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229568 00010000:00010000:3.0:1782487587.723788:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.723790:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.723792:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229568 00010000:00010000:3.0:1782487587.723801:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.723815:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723819:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299230080 00000100:00100000:2.0:1782487587.723823:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299230080 00010000:00010000:3.0:1782487587.723826:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e06ff66/0x66475b4e8b85e498 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.723845:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229952 00000100:00100000:1.0:1782487587.723846:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.723847:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.723849:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229952 00010000:00010000:3.0:1782487587.723851:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.723856:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.723866:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3316:x1869066299226880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10355us (10808us total) trans 8589940036 rc 0/0 00010000:00010000:3.0:1782487587.723873:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.723874:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16306 00000100:00100000:1.0:1782487587.723883:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.723883:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16297 00000100:00100000:2.0:1782487587.723888:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3317:x1869066299229568:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.723905:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+147:2360:x1869066294404608:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 551us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.723908:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229824 00002000:00080000:2.0:1782487587.723909:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6082 count 1 00000100:00100000:1.0:1782487587.723911:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487587.723915:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229824 00000100:00100000:3.0:1782487587.723919:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6187 00000100:00100000:1.0:1782487587.723921:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.723928:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723940:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 128 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.723946:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=6s v=(0 0) 00000100:00100000:0.0:1782487587.723951:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16307 00010000:00010000:2.0:1782487587.723954:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.723954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.723961:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.723965:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3317:x1869066299230080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.723984:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6097 count 1 00010000:00010000:2.0:1782487587.723992:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 128 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.723994:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df5c00/2, rc 0, transno 8589940036 00010000:00010000:0.0:1782487587.723999:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.724006:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299226880:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.724016:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 128 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724025:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 135 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.724028:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573532a00/2, rc 0, transno 8589940035 00000100:00100000:2.0:1782487587.724035:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299230208:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.724036:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299227648:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.724046:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d1:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.724051:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.724055:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724057:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724076:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724080:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be480 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.724092:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 135 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724094:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724096:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299229696 00000100:00100000:2.0:1782487587.724101:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299229696 00010000:00010000:1.0:1782487587.724116:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724119:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724123:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16308 00000100:00100000:2.0:1782487587.724134:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3317:x1869066299229952:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.724140:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.724148:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299230336:192.168.202.21@tcp:104: 00002000:00080000:2.0:1782487587.724149:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6096 count 1 00010000:00010000:2.0:1782487587.724161:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724172:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724185:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d0:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.724199:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.724203:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.724205:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.724228:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724239:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.724249:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16309 00000100:00100000:2.0:1782487587.724254:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299230464:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.724261:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3315:x1869066299229824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.724276:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6093 count 1 00010000:00010000:0.0:1782487587.724289:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724297:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.724302:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 135 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724312:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.724315:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.724318:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3316:x1869066299228160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8458us (8834us total) trans 8589940037 rc 0/0 00010000:00010000:0.0:1782487587.724321:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724326:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16310 00000100:00100000:1.0:1782487587.724337:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16302 00000100:00100000:2.0:1782487587.724339:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3315:x1869066299229696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.724349:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 135 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.724352:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6084 count 1 00010000:00010000:1.0:1782487587.724358:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.724364:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 135 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724365:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724366:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724393:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.724398:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.724398:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299230592:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.724400:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724417:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.724420:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.724422:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724425:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.724435:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67840 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.724448:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724454:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724466:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ad4321/0x66475b4e8b85e4bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724468:0:213220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae41772f/0x66475b4e8b84fb22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47418c expref: 135 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724471:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.724498:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299230720:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.724504:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.724508:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.724509:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299228928:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.724513:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.724521:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.724527:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.724535:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c47480/2, rc 0, transno 8589940037 00010000:00010000:2.0:1782487587.724537:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.724538:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.724544:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299228160:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.724548:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724556:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724561:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724565:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724573:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724587:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724593:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724598:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724630:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724632:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724653:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.724664:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782487587.724669:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.724680:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1782487587.724859:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+27:3316:x1869066299229312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5918us (6008us total) trans 8589940699 rc 0/0 00000100:00100000:2.0:1782487587.724864:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16305 00010000:00010000:2.0:1782487587.724897:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.724902:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724910:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.724914:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.724918:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+25:3315:x1869066299226240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11684us (12368us total) trans 8589940038 rc 0/0 00000100:00100000:0.0:1782487587.724929:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3315:x1869066299228800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8380us (8457us total) trans 8589940700 rc 0/0 00010000:00010000:2.0:1782487587.724932:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.724936:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16295 00000100:00100000:0.0:1782487587.724945:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16303 00010000:00010000:2.0:1782487587.724950:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724956:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2d8c439/0x66475b4e8b85e4c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724962:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.724968:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724969:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.724976:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.724992:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.724997:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.724998:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.725005:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725017:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725022:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725026:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725042:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081134fa8/0x66475b4e8b85e48a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725047:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725053:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.725056:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.725058:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.725058:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000254e1db7/0x66475b4e8b85e4d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725081:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.725084:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.725088:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.725156:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299230848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.725162:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725171:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725181:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.725212:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725231:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.725235:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487587.725245:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299230976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.725247:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.725255:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725261:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.725265:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725271:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725283:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.725292:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e483 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725310:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.725311:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299230848 00010000:00010000:3.0:1782487587.725313:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.725315:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299230848 00010000:00010000:3.0:1782487587.725318:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.725341:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299230976 00000100:00100000:2.0:1782487587.725343:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299230976 00000100:00100000:3.0:1782487587.725356:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16311 00000100:00100000:2.0:1782487587.725366:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16312 00000100:00100000:3.0:1782487587.725371:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3314:x1869066299230848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.725377:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+26:3314:x1869066299230976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487587.725385:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6092 count 1 00002000:00080000:2.0:1782487587.725389:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6090 count 1 00010000:00010000:3.0:1782487587.725397:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725401:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725404:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3314:x1869066299225856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12296us (12905us total) trans 8589940701 rc 0/0 00010000:00010000:3.0:1782487587.725420:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725425:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16294 00010000:00010000:2.0:1782487587.725426:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725437:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.725440:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ca:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1782487587.725441:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00000004:00080000:0.0:1782487587.725443:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df4a80/2, rc 0, transno 8589940701 00010000:00010000:2.0:1782487587.725448:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.725450:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725451:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725452:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725459:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299225856:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.725477:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725483:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725488:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725489:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725498:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725515:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.725516:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.725523:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299231232:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.725543:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299231360:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.725548:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.725585:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.725586:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.725632:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.725638:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725646:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.725650:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725658:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.725668:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725671:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.725689:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725703:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009954e5b5/0x66475b4e8b85e4ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725703:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3317:x1869066299227904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10119us (10534us total) trans 8589940702 rc 0/0 00010000:00010000:0.0:1782487587.725706:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725721:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16300 00010000:00010000:0.0:1782487587.725730:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725742:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.725747:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.725750:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782487587.725758:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.725763:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725772:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725773:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299231104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.725794:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.725802:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80992e4/0x66475b4e8b85e491 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.725814:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.725819:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.725822:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.725825:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.725846:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299231104 00000100:00100000:3.0:1782487587.725851:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299231104 00000004:00080000:1.0:1782487587.725853:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c44e00/2, rc 0, transno 8589940699 00000100:00100000:1.0:1782487587.725865:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299229312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.725877:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782487587.725887:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16313 00000100:00100000:1.0:1782487587.725887:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299231488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.725902:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+28:3316:x1869066299231104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.725913:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3317:x1869066299227008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12561us (12900us total) trans 8589940039 rc 0/0 00002000:00080000:3.0:1782487587.725917:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6085 count 1 00000100:00100000:0.0:1782487587.725923:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16296 00000100:00100000:1.0:1782487587.725924:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.725932:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.725946:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 128 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725947:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299231488 00000100:00100000:0.0:1782487587.725953:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299231488 00010000:00010000:3.0:1782487587.725958:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1782487587.725963:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.725967:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725987:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16314 00010000:00010000:3.0:1782487587.725994:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 128 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.725999:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3316:x1869066299231488:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.726005:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.726014:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 128 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.726018:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6098 count 1 00000004:00080000:1.0:1782487587.726030:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c44700/2, rc 0, transno 8589940700 00000100:00100000:3.0:1782487587.726031:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299231744:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.726034:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726043:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299228800:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.726061:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 134 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.726064:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549181c00/2, rc 0, transno 8589940038 00010000:00010000:0.0:1782487587.726073:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d2:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.726076:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.726079:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299226240:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.726082:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726089:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487587.726090:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9840 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.726100:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299231616:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.726107:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 134 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726119:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 134 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.726130:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb476c08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299231872:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.726138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.726169:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.726205:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299231616 00000100:00100000:0.0:1782487587.726210:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299231616 00010000:00010000:1.0:1782487587.726233:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.726249:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16315 00000100:00100000:0.0:1782487587.726258:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+27:3315:x1869066299231616:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.726259:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c47100/2, rc 0, transno 8589940702 00000100:00100000:1.0:1782487587.726273:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299227904:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.726274:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6099 count 1 00000004:00080000:1.0:1782487587.726290:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb45036b480/2, rc 0, transno 8589940039 00010000:00010000:0.0:1782487587.726290:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726301:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299227008:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.726305:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726309:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782487587.726317:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d3:0x0].0x0 since=6s v=(0 0) 00000100:00100000:1.0:1782487587.726321:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299232128:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.726322:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.726330:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726356:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.726370:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.726383:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299232256:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.726416:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67180 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.726452:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b08d4e8/0x66475b4e8b8517d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4749dc expref: 128 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.726465:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299229184:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.726477:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782487587.726484:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726487:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299232384:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.726500:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726513:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726523:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.726527:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726536:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726555:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.726557:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299232128 00000100:00100000:1.0:1782487587.726562:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299232128 00000100:00100000:1.0:1782487587.726583:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299232384 00000100:00100000:1.0:1782487587.726586:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299232384 00000100:00100000:1.0:1782487587.726622:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16316 00000100:00100000:1.0:1782487587.726631:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:3317:x1869066299232128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.726646:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6093 count 1 00010000:00010000:1.0:1782487587.726658:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.726672:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.726680:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.726684:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.726688:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.726710:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.726722:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726734:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299232640:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.726747:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16317 00000100:00100000:3.0:1782487587.726762:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+30:3316:x1869066299232384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487587.726777:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6091 count 1 00000100:00100000:1.0:1782487587.726779:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.726784:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+30:3315:x1869066299229056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9697us (9768us total) trans 8589940040 rc 0/0 00010000:00010000:3.0:1782487587.726793:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.726793:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16304 00000100:00100000:1.0:1782487587.726801:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299232000:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.726812:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.726821:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1782487587.726825:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.726829:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726833:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.726837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.726841:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726851:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.726855:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726864:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.726873:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c46300/2, rc 0, transno 8589940040 00010000:00010000:0.0:1782487587.726877:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726884:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229056:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.726897:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077261c40/0x66475b4e8b85e4c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726899:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.726910:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299232512:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.726916:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 107 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.726922:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.726927:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.726931:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.726941:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.726941:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.726945:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299232000 00000100:00100000:0.0:1782487587.726951:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299232000 00000100:00100000:3.0:1782487587.726959:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299232768:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.726977:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299232512 00000100:00100000:0.0:1782487587.726981:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299232512 00000100:00100000:3.0:1782487587.726993:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.727006:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487587.727009:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16318 00000100:00100000:1.0:1782487587.727018:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299232896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.727020:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3315:x1869066299232000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.727036:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6100 count 1 00010000:00010000:0.0:1782487587.727051:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.727057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.727069:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 134 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727078:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.727081:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.727085:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.727088:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299232896 00000100:00100000:1.0:1782487587.727094:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299232896 00010000:00010000:0.0:1782487587.727111:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 134 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.727121:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16319 00000100:00100000:1.0:1782487587.727132:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3315:x1869066299232512:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.727134:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 134 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.727146:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6101 count 1 00000100:00100000:0.0:1782487587.727151:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299233024:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.727160:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727174:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 146 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727182:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d5:0x0].0x0 since=6s v=(0 0) 00000100:00100000:0.0:1782487587.727182:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67240 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.727200:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.727205:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.727222:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16320 00010000:00010000:1.0:1782487587.727227:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 146 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.727236:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3314:x1869066299232896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.727243:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 146 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.727252:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6089 count 1 00000100:00100000:1.0:1782487587.727256:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299233152:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.727267:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727280:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 127 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.727284:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.727288:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c9:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.727293:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.727297:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727320:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 127 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727332:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 127 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.727350:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299233280:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.727370:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.727382:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67300 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.727390:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727400:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727409:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727417:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.727435:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.727440:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.727445:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.727452:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.727455:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.727461:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.727472:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.727477:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e467 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.727493:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.727496:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.727499:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.727595:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:3316:x1869066299225472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16286us (16378us total) trans 8589940703 rc 0/0 00000100:00100000:1.0:1782487587.727603:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16290 00000100:00100000:1.0:1782487587.727672:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2360:x1869066294402944:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 6082us (6588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.727683:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6175 00000004:00080000:3.0:1782487587.727726:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df5f80/2, rc 0, transno 8589940703 00000100:00100000:3.0:1782487587.727743:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299225472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.727796:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299233408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.727825:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.727851:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299233408 00000100:00100000:0.0:1782487587.727856:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299233408 00000100:00100000:0.0:1782487587.727896:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16321 00000100:00100000:0.0:1782487587.727905:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3316:x1869066299233408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.727917:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6103 count 1 00010000:00010000:0.0:1782487587.727931:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727945:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727953:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d7:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782487587.727957:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.727962:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727983:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.727993:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.728010:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299233536:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.728057:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67900 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.728162:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299230336:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.728180:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728247:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299230464:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.728263:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728288:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299230208:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.728300:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.728387:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299230592:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.728411:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728415:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299230720:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.728433:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728461:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299231360:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.728472:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.728559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.728584:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405376 00000100:00100000:2.0:1782487587.728589:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405376 00000100:00100000:3.0:1782487587.728598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.728631:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.728654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.728666:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405504 00000100:00100000:2.0:1782487587.728671:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405504 00010000:00010000:2.0:1782487587.728687:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 108 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.728687:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404736 00000100:00100000:0.0:1782487587.728694:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404736 00000100:00100000:3.0:1782487587.728696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.728716:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728721:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404992 00000100:00100000:2.0:1782487587.728726:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404992 00000100:00100000:3.0:1782487587.728738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.728744:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 129 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.728754:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405248 00000100:00100000:0.0:1782487587.728759:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405248 00000100:00100000:1.0:1782487587.728760:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6188 00000100:00100000:2.0:1782487587.728769:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6189 00000100:00100000:3.0:1782487587.728770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.728775:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2362:x1869066294405376:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.728779:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 109 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728786:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2363:x1869066294405504:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.728786:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.728796:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.728801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.728802:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.728807:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294404864 00010000:00010000:2.0:1782487587.728812:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 109 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.728813:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294404864 00010000:00010000:1.0:1782487587.728819:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.728832:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 109 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.728833:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 136 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.728843:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c278412/0x66475b4e8b851aa2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aca expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.728861:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb925422/0x66475b4e8b8523af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c7c expref: 109 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.728868:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.728876:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.728881:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405120 00010000:00010000:1.0:1782487587.728883:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.728884:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.728886:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405120 00010000:00010000:2.0:1782487587.728893:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.728904:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.728905:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.728905:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 137 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.728916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.728933:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.728943:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.728943:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405632 00000100:00100000:0.0:1782487587.728948:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405632 00000100:00100000:3.0:1782487587.728954:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299231232:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.728958:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.728961:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.728966:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 129 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.728972:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.728975:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.728990:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2363:x1869066294405504:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.729001:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6190 00010000:00010000:1.0:1782487587.729002:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.729012:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6189 00010000:00010000:1.0:1782487587.729013:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.729014:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+137:2360:x1869066294404736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.729021:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299231744:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.729031:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.729036:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6191 00010000:00010000:1.0:1782487587.729040:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.729040:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 137 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.729043:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.729049:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066294404992:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.729071:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.729071:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 137 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729079:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 129 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729092:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002370b977/0x66475b4e8b84fb8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741b6 expref: 137 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729095:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 129 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729119:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729123:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e12beb12/0x66475b4e8b8519b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474a99 expref: 129 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729125:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729135:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729140:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729146:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729146:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729154:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729164:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729171:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.729197:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.729211:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729214:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3315:x1869066299229696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4876us (5265us total) trans 8589940041 rc 0/0 00000100:00100000:0.0:1782487587.729217:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+136:2360:x1869066294404736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 204us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.729226:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2360:x1869066294404992:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.729232:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16310 00010000:00010000:3.0:1782487587.729237:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.729238:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6190 00000100:00100000:2.0:1782487587.729248:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6191 00010000:00010000:1.0:1782487587.729258:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.729262:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6192 00010000:00010000:1.0:1782487587.729265:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.729273:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6193 00000100:00100000:0.0:1782487587.729274:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2360:x1869066294405248:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.729283:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547117800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.729289:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+135:2360:x1869066294404864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.729289:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.729290:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729299:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729304:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.729307:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729315:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729328:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729346:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729353:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.729355:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729361:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd6f35e/0x66475b4e8b852385 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c6e expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729368:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af7a1f19/0x66475b4e8b84fb92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4741af expref: 135 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729375:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d075e391/0x66475b4e8b85e4f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.729383:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729392:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729399:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729402:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729409:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.729409:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.729412:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729413:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.729416:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.729421:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.729436:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c47800/2, rc 0, transno 8589940041 00010000:00010000:2.0:1782487587.729445:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729447:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729450:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229696:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.729468:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.729474:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.729482:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782487587.729482:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.729483:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.729484:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.729490:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729498:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729511:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.729512:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2360:x1869066294404864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 225us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.729524:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2360:x1869066294405248:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 251us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.729532:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6193 00010000:00010000:1.0:1782487587.729542:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e08f6b8/0x66475b4e8b85e4d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.729543:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6192 00000100:00100000:2.0:1782487587.729556:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6194 00010000:00010000:1.0:1782487587.729564:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.729569:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+133:2360:x1869066294405120:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.729570:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.729571:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6195 00010000:00010000:1.0:1782487587.729573:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.729584:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.729586:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+127:2360:x1869066294405632:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.729592:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 133 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729601:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.729638:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 133 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729641:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782487587.729641:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 127 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729655:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299233664:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.729666:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc9d8a5f/0x66475b4e8b84f900 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474107 expref: 133 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.729667:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3317:x1869066299229568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5784us (6027us total) trans 8589940042 rc 0/0 00010000:00010000:0.0:1782487587.729670:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 127 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.729695:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729700:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729703:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674da71f/0x66475b4e8b851a94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ad8 expref: 127 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729706:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.729716:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299233664 00000100:00100000:1.0:1782487587.729722:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299233664 00010000:00010000:2.0:1782487587.729728:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729728:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729736:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.729746:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729758:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.729761:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.729762:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16306 00000100:00100000:2.0:1782487587.729782:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2360:x1869066294405120:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 216us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.729789:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16322 00010000:00010000:0.0:1782487587.729789:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.729794:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6194 00000100:00100000:1.0:1782487587.729804:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:3316:x1869066299233664:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.729819:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2360:x1869066294405632:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 235us (907us total) trans 0 rc 0/0 00002000:00080000:1.0:1782487587.729821:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6086 count 1 00010000:00010000:2.0:1782487587.729827:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.729833:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6195 00010000:00010000:1.0:1782487587.729837:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729842:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729858:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729858:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 125 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729859:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729882:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.729888:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.729890:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729891:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729893:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729920:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.729926:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.729929:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729932:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 125 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.729953:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 125 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.729956:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.729968:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299233792:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.730012:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534470c0 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.730048:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c45500/2, rc 0, transno 8589940042 00000100:00100000:1.0:1782487587.730058:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299229568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.730138:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299232640:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.730145:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+33:3314:x1869066299230976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4769us (4864us total) trans 8589940043 rc 0/0 00000100:00100000:2.0:1782487587.730153:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16312 00010000:00010000:1.0:1782487587.730157:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730176:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730183:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730185:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299233920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.730201:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb476c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3314:x1869066299230848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4823us (4999us total) trans 8589940044 rc 0/0 00010000:00010000:2.0:1782487587.730213:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.730218:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16311 00010000:00010000:2.0:1782487587.730224:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730238:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.730238:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.730262:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299232256:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.730278:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573530a80/2, rc 0, transno 8589940043 00010000:00010000:0.0:1782487587.730287:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730289:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299230976:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.730312:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573530380/2, rc 0, transno 8589940044 00000100:00100000:1.0:1782487587.730319:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299230848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.730330:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb476c08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299231872:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.730350:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730357:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299233152:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.730366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.730381:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.730381:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.730388:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3317:x1869066299229952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6254us (6608us total) trans 8589940704 rc 0/0 00000100:00100000:3.0:1782487587.730402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.730406:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16308 00010000:00010000:0.0:1782487587.730408:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.730419:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299233920 00000100:00100000:2.0:1782487587.730425:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299233920 00010000:00010000:0.0:1782487587.730429:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.730433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.730441:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.730450:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16323 00000100:00100000:2.0:1782487587.730459:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3314:x1869066299233920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.730459:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1782487587.730469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00002000:00080000:2.0:1782487587.730472:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6095 count 1 00010000:00010000:2.0:1782487587.730484:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730495:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 105 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730505:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cf:0x0].0x0 since=5s v=(0 0) 00000100:00100000:3.0:1782487587.730506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.730512:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.730513:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234048:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.730519:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.730531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.730546:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 105 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.730563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.730568:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 105 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.730582:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299234304:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.730602:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.730625:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299234176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.730658:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be480 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.730665:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.730665:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+33:3316:x1869066299231104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4765us (4850us total) trans 8589940045 rc 0/0 00000100:00100000:0.0:1782487587.730675:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16313 00010000:00010000:2.0:1782487587.730690:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782487587.730695:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.730699:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299234048 00000004:00080000:1.0:1782487587.730706:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573533800/2, rc 0, transno 8589940045 00000100:00100000:0.0:1782487587.730706:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299234048 00010000:00010000:2.0:1782487587.730707:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547116e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.730713:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730719:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299231104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.730722:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730735:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.730736:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299234176 00000100:00100000:0.0:1782487587.730741:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299234176 00010000:00010000:2.0:1782487587.730743:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023086cc/0x66475b4e8b85e501 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730744:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.730752:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730761:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.730763:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1782487587.730764:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299232768:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.730766:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16324 00010000:00010000:1.0:1782487587.730768:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730769:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.730782:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+34:3315:x1869066299234048:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.730788:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4ca162a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.730796:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730797:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.730799:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.730802:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6088 count 1 00010000:00010000:2.0:1782487587.730815:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.730819:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730828:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730838:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.730848:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 125 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730851:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab32fc0c/0x66475b4e8b85e4fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730854:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cbbef58/0x66475b4e8b85e4e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.730869:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.730876:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.730879:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730890:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.730892:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.730895:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730897:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.730897:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 125 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.730901:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.730915:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.730922:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.730923:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 125 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730938:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16325 00010000:00010000:2.0:1782487587.730942:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.730951:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+34:3316:x1869066299234176:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.730953:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299234432:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.730954:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730965:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85e508 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.730968:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6087 count 1 00010000:00010000:2.0:1782487587.730977:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.730980:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.730982:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.730982:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.730991:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.730993:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67180 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.730997:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 125 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731001:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405888 00000100:00100000:2.0:1782487587.731006:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405888 00010000:00010000:1.0:1782487587.731008:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.731012:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731013:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.731021:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731022:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 132 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731048:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731054:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294405760 00010000:00010000:0.0:1782487587.731055:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731057:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294405760 00010000:00010000:1.0:1782487587.731063:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 125 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731065:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731071:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731093:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 126 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731093:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.731097:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406016 00000100:00100000:2.0:1782487587.731101:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406016 00000100:00100000:1.0:1782487587.731111:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299234688:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.731115:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 133 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731123:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406144 00000100:00100000:2.0:1782487587.731124:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406144 00010000:00010000:2.0:1782487587.731137:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 106 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731153:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406528 00000100:00100000:2.0:1782487587.731156:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406528 00000100:00100000:1.0:1782487587.731166:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.731174:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 146 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731205:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.731206:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406272 00000100:00100000:2.0:1782487587.731211:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406272 00000100:00100000:1.0:1782487587.731218:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299234560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.731229:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 134 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731251:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3317:x1869066299230080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7289us (7549us total) trans 8589940705 rc 0/0 00000100:00100000:2.0:1782487587.731252:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406400 00000100:00100000:1.0:1782487587.731256:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.731258:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406400 00000100:00100000:0.0:1782487587.731265:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16307 00010000:00010000:2.0:1782487587.731273:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 107 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.731287:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299234560 00000100:00100000:2.0:1782487587.731292:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406656 00000100:00100000:3.0:1782487587.731294:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299234560 00000100:00100000:2.0:1782487587.731296:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406656 00010000:00010000:1.0:1782487587.731298:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.731304:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731311:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 147 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731315:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.731320:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299233536:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.731322:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731333:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6196 00010000:00010000:1.0:1782487587.731334:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.731337:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16326 00010000:00010000:0.0:1782487587.731339:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731345:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+134:2361:x1869066294405888:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.731357:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.731363:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731363:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731381:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299233024:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.731388:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85e4de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731393:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731397:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731411:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.731416:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.731418:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3316:x1869066299234560:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.731421:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.731425:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d7690e/0x66475b4e8b84fed3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742ab expref: 134 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731432:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6197 00010000:00010000:2.0:1782487587.731435:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00002000:00080000:3.0:1782487587.731437:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6094 count 1 00010000:00010000:2.0:1782487587.731439:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.731441:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2361:x1869066294405760:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.731447:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731455:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.731456:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.731457:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.731457:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c45c00/2, rc 0, transno 8589940704 00010000:00010000:0.0:1782487587.731464:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731472:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299229952:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.731491:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.731492:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 107 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731492:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.731493:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c46a00/2, rc 0, transno 8589940705 00000100:00100000:1.0:1782487587.731502:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299230080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.731514:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+133:2361:x1869066294405888:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (1153us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.731515:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.731522:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c9:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.731524:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6196 00010000:00010000:0.0:1782487587.731531:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731541:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731547:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6198 00000100:00100000:2.0:1782487587.731562:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+132:2361:x1869066294406016:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.731563:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.731564:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=5s v=(0 0) 00000100:00100000:1.0:1782487587.731564:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234944:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.731573:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.731579:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731579:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.731591:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 132 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731591:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2361:x1869066294405760:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 147us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.731602:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.731632:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6197 00000100:00100000:0.0:1782487587.731661:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6199 00000100:00100000:0.0:1782487587.731672:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5585e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2361:x1869066294406144:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.731685:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.731688:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 132 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731692:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1782487587.731694:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731702:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234816:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.731713:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609159ad/0x66475b4e8b84fdc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47426c expref: 132 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.731736:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731739:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.731747:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.731751:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731758:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b8523a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c75 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731761:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299234944 00000100:00100000:1.0:1782487587.731767:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299234944 00010000:00010000:2.0:1782487587.731779:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731784:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.731789:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.731791:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299234816 00010000:00010000:0.0:1782487587.731794:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731796:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299234816 00010000:00010000:3.0:1782487587.731802:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 106 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731803:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.731807:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.731818:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16327 00010000:00010000:3.0:1782487587.731824:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 106 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.731831:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+131:2361:x1869066294406016:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 270us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.731832:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3315:x1869066299234944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.731838:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.731847:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6198 00000100:00100000:3.0:1782487587.731852:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299235072:192.168.202.21@tcp:104: 00002000:00080000:1.0:1782487587.731853:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6104 count 1 00000100:00100000:0.0:1782487587.731862:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5585e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2361:x1869066294406144:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.731866:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6200 00010000:00010000:1.0:1782487587.731868:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731876:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6199 00000100:00100000:2.0:1782487587.731880:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+147:2361:x1869066294406528:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.731889:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 147 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731892:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.731900:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d8:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.731902:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 147 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731908:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.731917:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731921:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6201 00010000:00010000:2.0:1782487587.731925:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 147 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.731938:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+130:2361:x1869066294406272:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.731948:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab99c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.731948:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f24c6276/0x66475b4e8b8501a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474376 expref: 147 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.731950:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 147 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.731950:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.731961:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 130 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731972:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.731979:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 146 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.731980:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.731990:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732006:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 130 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.732013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.732030:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732033:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299235200:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.732042:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6721530/0x66475b4e8b85001c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4742dc expref: 130 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732049:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.732055:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.732059:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.732062:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732067:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.732068:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732072:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+146:2361:x1869066294406528:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.732084:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6200 00000100:00100000:1.0:1782487587.732091:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16328 00010000:00010000:0.0:1782487587.732094:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.732098:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406784 00000100:00100000:2.0:1782487587.732103:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406784 00000100:00100000:1.0:1782487587.732103:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5491c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3315:x1869066299234816:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.732118:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 126 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.732119:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6102 count 1 00000100:00100000:0.0:1782487587.732123:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2361:x1869066294406272:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (1589us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.732134:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.732140:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6201 00010000:00010000:1.0:1782487587.732152:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732156:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6202 00000100:00100000:0.0:1782487587.732164:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6203 00010000:00010000:1.0:1782487587.732165:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d6:0x0].0x0 since=6s v=(0 0) 00000100:00100000:2.0:1782487587.732167:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2362:x1869066294406400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.732174:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.732176:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2363:x1869066294406656:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.732178:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.732179:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732186:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 105 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732198:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.732208:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732216:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 105 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732224:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732245:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081be75aa/0x66475b4e8b8523a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474c67 expref: 105 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732247:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732249:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732279:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb634f04/0x66475b4e8b8502bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4743d8 expref: 145 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732281:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299235328:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.732282:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.732291:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.732298:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732300:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.732308:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.732309:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732316:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732320:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.732329:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.732329:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732339:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732349:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732353:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.732354:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2362:x1869066294406400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (1791us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.732366:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732367:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6202 00010000:00010000:1.0:1782487587.732378:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732386:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6204 00010000:00010000:1.0:1782487587.732393:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.732396:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2361:x1869066294406784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.732405:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.732410:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 126 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732421:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 126 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732434:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.732437:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.732442:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732450:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.732459:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2363:x1869066294406656:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 284us (1857us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.732466:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.732470:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6203 00000100:00100000:2.0:1782487587.732492:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2361:x1869066294406784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 98us (483us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.732495:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732502:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6204 00010000:00010000:0.0:1782487587.732510:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732519:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732527:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732539:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732544:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.732554:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+36:3317:x1869066299232128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5923us (6197us total) trans 8589940046 rc 0/0 00010000:00010000:2.0:1782487587.732555:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732569:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16316 00010000:00010000:2.0:1782487587.732574:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.732582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.732590:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732595:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732627:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732630:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.732641:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732654:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.732666:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1782487587.732791:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3316:x1869066299233408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4886us (4965us total) trans 8589940706 rc 0/0 00000100:00100000:0.0:1782487587.732801:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16321 00010000:00010000:0.0:1782487587.732828:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.732832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.732837:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3315:x1869066299229824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8577us (8953us total) trans 8589940707 rc 0/0 00010000:00010000:0.0:1782487587.732846:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.732849:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16309 00010000:00010000:0.0:1782487587.732861:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.732869:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732872:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1782487587.732873:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3315:x1869066299232512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5741us (5933us total) trans 8589940708 rc 0/0 00010000:00010000:2.0:1782487587.732880:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732890:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16319 00010000:00010000:0.0:1782487587.732891:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1782487587.732900:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.732904:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732914:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732928:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732933:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009373c8c/0x66475b4e8b85e51d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.732939:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e6300/2, rc 0, transno 8589940708 00010000:00010000:2.0:1782487587.732948:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782487587.732952:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732953:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299232512:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.732961:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.732965:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.732970:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.732973:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c45f80/2, rc 0, transno 8589940707 00010000:00010000:2.0:1782487587.732979:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.732980:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299229824:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.732990:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85e540 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733002:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.733004:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733009:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.733011:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733017:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733024:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733030:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85e4ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733033:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.733038:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.733038:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733044:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733052:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.733053:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3315:x1869066299232000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6033us (6216us total) trans 8589940709 rc 0/0 00010000:00010000:2.0:1782487587.733054:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.733061:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733062:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733066:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16318 00010000:00010000:2.0:1782487587.733078:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733083:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733086:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733101:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299234432:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.733103:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e52b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733108:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733120:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733121:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733123:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733126:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733132:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.733137:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021667da5/0x66475b4e8b85e532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733141:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733154:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733159:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733163:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733164:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733166:0:213220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85245e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ce5 expref: 125 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733167:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.733171:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.733204:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b852465 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cf3 expref: 124 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733208:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299233280:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.733213:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.733227:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299233792:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.733230:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733241:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733244:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733253:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733258:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733270:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733271:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733291:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.733293:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.733310:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+33:3315:x1869066299231616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7053us (7174us total) trans 8589940710 rc 0/0 00010000:00010000:1.0:1782487587.733317:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.733320:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16315 00010000:00010000:0.0:1782487587.733322:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.733325:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.733334:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733338:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.733348:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.733350:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.733350:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733358:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733359:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.733364:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733379:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733387:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733391:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733403:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000664d5ba6/0x66475b4e8b85e539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733410:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733415:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.733420:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733425:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e516 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733439:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.733444:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733449:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733456:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733457:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733461:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733463:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e547 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733466:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733480:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733483:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733486:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.733500:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733509:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733518:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733528:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3314:x1869066299232896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6294us (6473us total) trans 8589940047 rc 0/0 00010000:00010000:2.0:1782487587.733536:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733537:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+37:3316:x1869066299233664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3735us (3849us total) trans 8589940048 rc 0/0 00000100:00100000:0.0:1782487587.733544:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16320 00000100:00100000:1.0:1782487587.733554:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16322 00010000:00010000:2.0:1782487587.733564:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.733574:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407040 00000100:00100000:0.0:1782487587.733580:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407040 00010000:00010000:3.0:1782487587.733585:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1782487587.733590:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e5c00/2, rc 0, transno 8589940047 00010000:00010000:3.0:1782487587.733592:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733604:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 124 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733622:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299232896:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.733624:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.733631:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733653:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733669:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733673:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294406912 00000100:00100000:1.0:1782487587.733678:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299235712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.733679:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294406912 00010000:00010000:3.0:1782487587.733689:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d2ba0ad/0x66475b4e8b85e524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.733702:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 125 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.733710:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.733715:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.733716:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.733719:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.733725:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6205 00000100:00100000:0.0:1782487587.733735:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2360:x1869066294407040:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.733746:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.733747:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3316:x1869066299232384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6990us (7227us total) trans 8589940049 rc 0/0 00000100:00100000:1.0:1782487587.733755:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299235456:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.733755:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 125 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.733756:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16317 00000100:00100000:2.0:1782487587.733769:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299235712 00000100:00100000:2.0:1782487587.733772:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299235712 00010000:00010000:0.0:1782487587.733775:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 125 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733791:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.733793:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.733795:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16329 00010000:00010000:0.0:1782487587.733801:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.733804:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3314:x1869066299235712:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.733809:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.733817:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6096 count 1 00000004:00080000:1.0:1782487587.733819:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4a80/2, rc 0, transno 8589940048 00010000:00010000:0.0:1782487587.733820:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733828:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733831:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299233664:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.733838:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.733844:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 103 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.733850:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d0:0x0].0x0 since=5s v=(0 0) 00000004:00080000:1.0:1782487587.733851:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e5880/2, rc 0, transno 8589940706 00010000:00010000:2.0:1782487587.733854:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.733858:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733862:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299233408:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.733876:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e6680/2, rc 0, transno 8589940049 00000100:00100000:0.0:1782487587.733877:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2360:x1869066294407040:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 141us (1297us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.733879:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 103 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.733885:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299232384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.733895:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6205 00000100:00100000:1.0:1782487587.733898:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.733909:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5491c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299235584:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.733914:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 103 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.733920:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6206 00000100:00100000:2.0:1782487587.733934:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299235840:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.733936:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5585e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2360:x1869066294406912:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.733940:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.733954:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.733960:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 124 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.733965:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299235456 00000100:00100000:3.0:1782487587.733971:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299235456 00010000:00010000:0.0:1782487587.733975:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 124 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.733978:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.733995:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6c053e2/0x66475b4e8b852506 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d16 expref: 124 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734005:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299235584 00010000:00010000:0.0:1782487587.734009:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.734010:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299235584 00010000:00010000:2.0:1782487587.734014:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734016:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.734026:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734027:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734038:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16330 00010000:00010000:2.0:1782487587.734049:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734051:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3316:x1869066299235456:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.734051:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734066:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.734068:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16331 00002000:00080000:3.0:1782487587.734073:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6111 count 1 00000100:00100000:1.0:1782487587.734082:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+34:3316:x1869066299235584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.734088:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.734089:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734090:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1782487587.734097:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6112 count 1 00010000:00010000:3.0:1782487587.734104:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734113:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17df:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.734114:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.734119:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5585e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2360:x1869066294406912:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 186us (1287us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.734120:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.734129:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.734141:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.734149:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6206 00010000:00010000:1.0:1782487587.734157:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e0:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.734160:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.734165:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734170:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734201:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.734214:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3316:x1869066299231488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8218us (8292us total) trans 8589940711 rc 0/0 00000100:00100000:3.0:1782487587.734215:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299236352:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.734217:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.734227:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16314 00010000:00010000:0.0:1782487587.734234:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734244:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734248:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.734256:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734270:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.734309:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.734313:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734322:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.734325:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734331:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734339:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.734341:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734345:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734348:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e50f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734366:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.734371:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734372:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.734376:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.734380:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.734399:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299234304:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.734411:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.734418:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+37:3315:x1869066299234048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3638us (3865us total) trans 8589940050 rc 0/0 00000100:00100000:0.0:1782487587.734427:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16324 00010000:00010000:3.0:1782487587.734452:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734469:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734477:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734498:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.734501:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.734505:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.734679:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1782487587.734679:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734693:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299235968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.734696:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734710:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b852530 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d0f expref: 122 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.734713:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547712300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299236480:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.734727:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.734735:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299234688:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.734751:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299235968 00010000:00010000:0.0:1782487587.734754:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.734755:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299235968 00000100:00100000:1.0:1782487587.734765:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447780 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.734766:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.734777:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.734785:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16332 00010000:00010000:0.0:1782487587.734787:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.734792:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491cb480/2, rc 0, transno 8589940050 00000100:00100000:2.0:1782487587.734793:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+35:3314:x1869066299235968:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.734794:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.734804:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734809:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234048:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.734810:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6106 count 1 00000100:00100000:1.0:1782487587.734811:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236224:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.734824:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.734831:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e7800/2, rc 0, transno 8589940709 00010000:00010000:0.0:1782487587.734832:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.734834:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734842:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17da:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.734845:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17da:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.734846:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299232000:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.734852:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.734852:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782487587.734863:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4000/2, rc 0, transno 8589940710 00000100:00100000:3.0:1782487587.734868:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299231616:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.734874:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734885:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 143 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.734889:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299236224 00000004:00080000:1.0:1782487587.734892:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e5500/2, rc 0, transno 8589940046 00000100:00100000:3.0:1782487587.734893:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299236224 00000100:00100000:2.0:1782487587.734902:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299236608:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.734902:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299232128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.734918:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782487587.734919:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16333 00000100:00100000:1.0:1782487587.734926:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.734930:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3317:x1869066299236224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.734940:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be480 going to sleep for 11 seconds 00002000:00080000:3.0:1782487587.734942:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6098 count 1 00010000:00010000:3.0:1782487587.734953:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734957:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.734957:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.734967:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734968:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 103 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.734986:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.734989:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.734990:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.734995:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.734997:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.734999:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+38:3316:x1869066299234176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4050us (4335us total) trans 8589940051 rc 0/0 00000100:00100000:0.0:1782487587.735019:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16325 00010000:00010000:2.0:1782487587.735037:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.735040:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299236096 00000100:00100000:0.0:1782487587.735046:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299236096 00010000:00010000:3.0:1782487587.735049:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 103 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735056:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735063:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 103 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735066:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299236736:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.735070:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e55c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.735077:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16334 00000100:00100000:0.0:1782487587.735091:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+38:3317:x1869066299236096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.735099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.735104:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.735107:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782487587.735107:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6097 count 1 00010000:00010000:2.0:1782487587.735112:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.735121:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735122:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.735126:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299236736 00000100:00100000:1.0:1782487587.735131:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299236864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.735132:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299236736 00010000:00010000:0.0:1782487587.735143:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 103 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.735153:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 103 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735162:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.735168:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d1:0x0].0x0 since=5s v=(0 0) 00000100:00100000:2.0:1782487587.735171:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16335 00010000:00010000:0.0:1782487587.735174:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.735180:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.735184:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299237120:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.735186:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+36:3314:x1869066299236736:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.735213:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299237248:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.735216:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6109 count 1 00000100:00100000:3.0:1782487587.735223:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9240 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.735231:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.735237:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299236864 00000100:00100000:1.0:1782487587.735243:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.735244:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299236864 00010000:00010000:2.0:1782487587.735248:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735257:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.735261:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.735261:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782487587.735267:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299237248 00010000:00010000:2.0:1782487587.735270:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.735272:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299237248 00000100:00100000:1.0:1782487587.735273:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.735297:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16336 00010000:00010000:2.0:1782487587.735302:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735306:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.735310:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3314:x1869066299236864:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.735324:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 143 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735326:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299236992 00002000:00080000:3.0:1782487587.735330:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6105 count 1 00000100:00100000:1.0:1782487587.735332:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299236992 00000100:00100000:2.0:1782487587.735344:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299237376:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.735356:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16337 00000100:00100000:1.0:1782487587.735365:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+40:3317:x1869066299237248:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.735373:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be900 going to sleep for 11 seconds 00002000:00080000:1.0:1782487587.735377:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6100 count 1 00010000:00010000:1.0:1782487587.735391:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.735397:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16338 00010000:00010000:1.0:1782487587.735409:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.735410:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3317:x1869066299236992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.735424:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d4:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.735427:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1782487587.735430:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6099 count 1 00010000:00010000:1.0:1782487587.735432:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735444:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735457:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.735462:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735463:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735472:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.735482:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.735490:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735491:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.735492:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735515:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d9:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1782487587.735518:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.735521:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299237504:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.735523:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.735531:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735548:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.735554:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735563:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 143 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.735570:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299237632:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.735575:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 103 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.735578:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 143 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.735596:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2362:x1869066294405376:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 6824us (7036us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.735602:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 103 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.735604:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.735630:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299237760:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.735631:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6188 00000100:00100000:0.0:1782487587.735652:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299237888:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.735705:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 103 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.735718:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 103 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.735729:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299238016:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.735749:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.735822:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9300 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.735837:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487587.735859:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c8000/2, rc 0, transno 8589940051 00000100:00100000:3.0:1782487587.735870:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299234176:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1782487587.735880:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573530000/2, rc 0, transno 8589940711 00000100:00100000:3.0:1782487587.735891:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299231488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.735936:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299238144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.735973:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299235072:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.735978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.736009:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.736014:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.736026:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299238272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.736066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.736067:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.736088:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407168 00000100:00100000:2.0:1782487587.736093:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407168 00000100:00100000:0.0:1782487587.736096:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299238144 00000100:00100000:0.0:1782487587.736101:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299238144 00000100:00100000:3.0:1782487587.736110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.736118:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 104 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.736124:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299235328:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.736131:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299238272 00000100:00100000:0.0:1782487587.736136:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299238272 00000100:00100000:3.0:1782487587.736143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.736147:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736152:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407424 00000100:00100000:2.0:1782487587.736158:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407424 00000100:00100000:0.0:1782487587.736167:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16339 00010000:00010000:2.0:1782487587.736179:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 144 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736179:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3314:x1869066299238144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.736185:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299235200:192.168.202.21@tcp:104: 00002000:00080000:0.0:1782487587.736207:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6101 count 1 00000100:00100000:2.0:1782487587.736217:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407296 00000100:00100000:2.0:1782487587.736221:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407296 00010000:00010000:0.0:1782487587.736221:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736237:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736238:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 145 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736257:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d5:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.736261:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.736265:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736274:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6207 00000100:00100000:2.0:1782487587.736284:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2360:x1869066294407168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.736292:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736293:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.736303:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 104 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736308:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736326:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 104 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736331:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299238400:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.736351:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b852cfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de1 expref: 104 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736361:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67900 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.736362:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.736368:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.736373:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736382:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6208 00010000:00010000:2.0:1782487587.736383:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736394:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+145:2361:x1869066294407424:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.736406:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.736408:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.736412:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736413:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736434:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2360:x1869066294407168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 149us (369us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.736443:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736453:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6207 00000100:00100000:3.0:1782487587.736473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.736473:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea9b41ee/0x66475b4e8b850483 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47444f expref: 145 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736481:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6209 00000100:00100000:1.0:1782487587.736482:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16340 00010000:00010000:0.0:1782487587.736496:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.736500:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2361:x1869066294407296:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.736501:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3314:x1869066299238272:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.736502:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.736512:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736517:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1782487587.736523:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6108 count 1 00010000:00010000:0.0:1782487587.736525:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736528:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 144 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.736538:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736555:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.736556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.736568:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 144 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736571:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 144 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736582:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+144:2361:x1869066294407424:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (469us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.736588:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dc:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.736597:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.736603:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6208 00000100:00100000:3.0:1782487587.736631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.736665:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736676:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407552 00000100:00100000:0.0:1782487587.736680:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407552 00010000:00010000:0.0:1782487587.736697:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 103 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736698:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd07d0b0/0x66475b4e8b85047c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474448 expref: 143 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.736701:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 143 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736727:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.736730:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407680 00010000:00010000:2.0:1782487587.736731:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.736734:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407680 00010000:00010000:2.0:1782487587.736737:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736746:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736749:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 104 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.736769:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407808 00000100:00100000:0.0:1782487587.736771:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407808 00010000:00010000:2.0:1782487587.736775:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.736784:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 142 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736786:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736801:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+142:2361:x1869066294407296:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 305us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.736811:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299238528:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.736818:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6209 00000100:00100000:0.0:1782487587.736826:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6210 00000100:00100000:0.0:1782487587.736836:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2361:x1869066294407552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.736843:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6211 00010000:00010000:0.0:1782487587.736844:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.736852:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 104 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.736859:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2361:x1869066294407680:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.736859:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.736868:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 104 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736873:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.736876:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736883:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 104 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736887:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7814f52/0x66475b4e8b852d95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474df6 expref: 104 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.736911:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736935:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 103 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736937:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.736938:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.736947:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.736956:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.736959:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736963:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.736966:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.736972:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.736984:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.736994:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.736995:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299236352:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.736995:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737000:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.737014:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737019:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.737033:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066294407552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 197us (825us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.737036:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.737041:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.737042:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6210 00000100:00100000:2.0:1782487587.737050:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066294407680:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (496us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.737052:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.737057:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.737063:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.737064:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6211 00000100:00100000:0.0:1782487587.737076:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6212 00010000:00010000:3.0:1782487587.737077:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.737085:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075dafd13/0x66475b4e8b85e571 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.737091:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+129:2361:x1869066294407808:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.737101:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737102:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.737105:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.737110:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.737111:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.737115:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.737117:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737132:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737133:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737154:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737160:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0734047/0x66475b4e8b850b28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474663 expref: 129 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737174:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.737180:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.737185:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.737204:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737212:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737232:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.737256:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2361:x1869066294407808:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.737264:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6212 00010000:00010000:0.0:1782487587.737285:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737293:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737302:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737310:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737324:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.737356:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3314:x1869066299233920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6898us (7119us total) trans 8589940052 rc 0/0 00000100:00100000:2.0:1782487587.737364:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16323 00010000:00010000:2.0:1782487587.737385:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.737390:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737399:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.737402:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737411:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737425:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737433:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e54e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737453:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.737458:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.737469:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3316:x1869066299235456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3419us (3677us total) trans 8589940713 rc 0/0 00010000:00010000:2.0:1782487587.737475:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.737481:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.737482:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16330 00000004:00080000:3.0:1782487587.737486:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c9180/2, rc 0, transno 8589940713 00010000:00010000:2.0:1782487587.737497:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.737501:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299235456:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.737517:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737526:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85e57f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737538:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.737541:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.737542:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.737564:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b853281 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47501f expref: 101 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.737576:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299235840:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.737588:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737596:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737604:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737634:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737642:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737646:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.737657:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737661:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.737670:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737679:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737687:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.737699:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.737827:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+42:3314:x1869066299235712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4024us (4112us total) trans 8589940053 rc 0/0 00000100:00100000:2.0:1782487587.737835:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16329 00000100:00100000:0.0:1782487587.737866:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3315:x1869066299234944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6036us (6266us total) trans 8589940714 rc 0/0 00010000:00010000:2.0:1782487587.737867:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.737882:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16327 00010000:00010000:2.0:1782487587.737883:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737893:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737901:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.737921:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1782487587.738084:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3316:x1869066299234560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6670us (6830us total) trans 8589940054 rc 0/0 00010000:00010000:3.0:1782487587.738093:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1782487587.738093:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16326 00010000:00010000:3.0:1782487587.738099:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738111:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976fa00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.738115:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.738117:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.738125:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738129:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.738142:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.738148:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738152:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.738160:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738162:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29c32f4/0x66475b4e8b85e578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.738183:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738202:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.738204:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ad4321/0x66475b4e8b85e56a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738208:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738221:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.738224:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738230:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.738233:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.738237:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.738242:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.738245:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738255:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e563 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.738575:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.738577:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.738581:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487587.738625:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c8700/2, rc 0, transno 8589940054 00000100:00100000:3.0:1782487587.738644:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299234560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.738673:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.738692:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299238656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.738722:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.738759:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299238656 00000100:00100000:0.0:1782487587.738762:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299238656 00000100:00100000:0.0:1782487587.738787:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341 00000100:00100000:0.0:1782487587.738794:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+42:3316:x1869066299238656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.738796:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299236608:192.168.202.21@tcp:104: 00002000:00080000:0.0:1782487587.738808:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6106 count 1 00010000:00010000:2.0:1782487587.738812:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.738822:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.738829:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5491c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+39:3315:x1869066299234816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5089us (5459us total) trans 8589940712 rc 0/0 00010000:00010000:0.0:1782487587.738834:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 100 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.738842:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16328 00010000:00010000:0.0:1782487587.738842:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17da:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.738847:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.738851:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.738867:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 100 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.738875:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 100 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.738882:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299238784:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.738911:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299237376:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.738925:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491cbb80/2, rc 0, transno 8589940712 00000100:00100000:0.0:1782487587.738928:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67840 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.738931:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.738932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.738941:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234816:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.738960:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c8e00/2, rc 0, transno 8589940714 00000100:00100000:2.0:1782487587.738964:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294407936 00000100:00100000:1.0:1782487587.738966:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299234944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.738970:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294407936 00010000:00010000:2.0:1782487587.738994:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.739027:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6213 00000100:00100000:1.0:1782487587.739029:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.739040:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2361:x1869066294407936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.739051:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.739058:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739068:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.739075:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739092:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.739094:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782487587.739097:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.739102:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739105:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239040:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.739120:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739136:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.739137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.739172:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2361:x1869066294407936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.739183:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6213 00000100:00100000:1.0:1782487587.739184:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299239168 00000100:00100000:3.0:1782487587.739198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.739202:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299239168 00000100:00100000:1.0:1782487587.739238:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299239040 00000100:00100000:1.0:1782487587.739241:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299239040 00000100:00100000:2.0:1782487587.739248:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408192 00000100:00100000:2.0:1782487587.739254:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408192 00000100:00100000:1.0:1782487587.739274:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16342 00010000:00010000:2.0:1782487587.739275:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 142 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739286:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3315:x1869066299239168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.739300:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6113 count 1 00000100:00100000:2.0:1782487587.739307:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6214 00010000:00010000:1.0:1782487587.739314:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.739319:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+142:2361:x1869066294408192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.739334:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.739336:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739342:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 142 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739349:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.739358:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.739365:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 142 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739365:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739397:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096658e65/0x66475b4e8b850930 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474583 expref: 142 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739402:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739427:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 127 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739431:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.739441:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17da:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.739446:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299239296:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.739448:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.739462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.739463:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739478:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.739488:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.739489:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408448 00000100:00100000:0.0:1782487587.739493:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408448 00010000:00010000:0.0:1782487587.739508:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 142 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739516:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16343 00000100:00100000:2.0:1782487587.739517:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+142:2361:x1869066294408192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 198us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.739531:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6214 00000100:00100000:1.0:1782487587.739531:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3315:x1869066299239040:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.739540:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6215 00000100:00100000:0.0:1782487587.739550:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2361:x1869066294408448:12345-192.168.202.21@tcp:103:ldlm_bl.0 00002000:00080000:1.0:1782487587.739553:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6107 count 1 00010000:00010000:2.0:1782487587.739560:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739561:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.739569:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739569:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 141 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739573:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739594:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 141 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739598:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739599:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 141 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739631:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17db:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.739636:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.739642:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739648:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008912369c/0x66475b4e8b85093e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745bb expref: 141 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739657:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739672:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.739677:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.739678:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 140 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.739681:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739682:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.739698:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.739702:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 140 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739716:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299239424:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.739717:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.739741:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2361:x1869066294408448:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 192us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.739745:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6215 00000100:00100000:3.0:1782487587.739760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.739771:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.739817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:1.0:1782487587.739819:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491cb100/2, rc 0, transno 8589940053 00000100:00100000:1.0:1782487587.739834:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299235712:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.739852:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c8a80/2, rc 0, transno 8589940052 00000100:00100000:1.0:1782487587.739858:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299233920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.739927:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+41:3314:x1869066299235968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5133us (5200us total) trans 8589940715 rc 0/0 00000004:00080000:1.0:1782487587.739936:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711500/2, rc 0, transno 8589940715 00000100:00100000:2.0:1782487587.739937:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16332 00000100:00100000:1.0:1782487587.739949:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299235968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.739966:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.739973:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.739983:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976ee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.739988:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.739997:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782487587.739998:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.740009:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.740015:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.740024:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004421972c/0x66475b4e8b85e58d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.740043:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.740047:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.740051:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.740055:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.740081:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299239808 00000100:00100000:2.0:1782487587.740085:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299237632:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.740087:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299239808 00010000:00010000:2.0:1782487587.740109:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.740122:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16344 00000100:00100000:1.0:1782487587.740134:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3315:x1869066299239808:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.740143:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.740145:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6114 count 1 00010000:00010000:2.0:1782487587.740156:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.740161:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.740165:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740167:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299237888:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.740184:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740185:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299238016:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.740186:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740217:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.740219:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e2:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.740226:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.740227:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.740236:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740252:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299238400:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.740260:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.740261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.740264:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.740286:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 127 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.740301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.740312:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299239936:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.740324:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408064 00000100:00100000:0.0:1782487587.740329:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408064 00000100:00100000:1.0:1782487587.740341:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447e40 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.740350:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.740357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.740369:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299238912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.740371:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408320 00000100:00100000:0.0:1782487587.740375:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408320 00010000:00010000:0.0:1782487587.740389:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 101 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.740397:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+42:3314:x1869066299236736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5216us (5298us total) trans 8589940716 rc 0/0 00000100:00100000:0.0:1782487587.740398:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408576 00000100:00100000:0.0:1782487587.740401:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408576 00000100:00100000:1.0:1782487587.740408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.740413:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16335 00010000:00010000:0.0:1782487587.740413:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740427:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408832 00000100:00100000:0.0:1782487587.740430:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408832 00000100:00100000:1.0:1782487587.740433:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299239680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.740435:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299238912 00000100:00100000:2.0:1782487587.740441:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299238912 00010000:00010000:0.0:1782487587.740441:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 140 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740456:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409088 00000100:00100000:1.0:1782487587.740457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.740460:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409088 00010000:00010000:0.0:1782487587.740471:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 141 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740481:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6216 00000100:00100000:0.0:1782487587.740484:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2361:x1869066294408064:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740489:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740492:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740498:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740506:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740508:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740511:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740515:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740522:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.740537:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+128:2361:x1869066294408064:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 51us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.740541:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6216 00000100:00100000:0.0:1782487587.740552:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6217 00000100:00100000:0.0:1782487587.740557:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294408320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740563:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740566:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 101 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.740574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.740582:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 101 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740594:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740598:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740602:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740628:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740638:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.740650:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294408320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 93us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.740653:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6217 00000100:00100000:0.0:1782487587.740661:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408704 00000100:00100000:0.0:1782487587.740663:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408704 00010000:00010000:0.0:1782487587.740669:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 101 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740677:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6218 00000100:00100000:0.0:1782487587.740681:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2360:x1869066294408576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740685:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740688:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740693:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740702:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000603cb6c2/0x66475b4e8b853598 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47510d expref: 121 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740709:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740711:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740714:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740718:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740728:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.740738:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2360:x1869066294408576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 57us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.740742:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6218 00000100:00100000:0.0:1782487587.740749:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6219 00000100:00100000:0.0:1782487587.740752:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2363:x1869066294408832:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740758:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740761:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 141 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740767:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 141 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740774:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740776:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740779:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740783:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740790:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.740800:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+141:2363:x1869066294408832:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 46us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.740804:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6219 00000100:00100000:0.0:1782487587.740814:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6220 00000100:00100000:0.0:1782487587.740819:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2363:x1869066294409088:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740823:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740826:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 140 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740837:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 140 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.740846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.740847:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740850:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.740853:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740858:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740867:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.740879:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+140:2363:x1869066294409088:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 61us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.740883:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6220 00000100:00100000:3.0:1782487587.740893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.740905:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294408960 00000100:00100000:0.0:1782487587.740908:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294408960 00010000:00010000:0.0:1782487587.740917:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740925:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409216 00000100:00100000:0.0:1782487587.740927:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409216 00010000:00010000:0.0:1782487587.740933:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 102 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.740949:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6221 00000100:00100000:0.0:1782487587.740954:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2363:x1869066294408704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.740958:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.740961:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 102 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740968:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 102 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740976:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b853288 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475026 expref: 102 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.740981:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095d4ee9d/0x66475b4e8b853392 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475081 expref: 102 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.740984:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.740998:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299237120:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.741002:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2363:x1869066294408704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.741009:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6221 00010000:00010000:3.0:1782487587.741020:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.741020:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6222 00000100:00100000:0.0:1782487587.741029:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2363:x1869066294408960:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.741039:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741039:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.741045:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.741056:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741059:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.741077:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741081:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b8536ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475192 expref: 120 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.741097:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741099:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.741105:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.741113:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741119:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.741122:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.741131:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.741143:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2363:x1869066294408960:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 116us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.741147:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6222 00000100:00100000:0.0:1782487587.741156:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6223 00000100:00100000:0.0:1782487587.741161:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294409216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.741166:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.741169:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 99 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741176:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 99 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741200:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85328f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475034 expref: 99 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741209:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.741211:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.741214:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741219:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741231:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.741245:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2361:x1869066294409216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.741250:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6223 00010000:00010000:0.0:1782487587.741266:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741272:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741277:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741281:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.741291:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1782487587.741298:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3317:x1869066299236224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6370us (6450us total) trans 8589940055 rc 0/0 00000100:00100000:3.0:1782487587.741306:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16333 00000100:00100000:0.0:1782487587.741405:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3314:x1869066299238144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5231us (5431us total) trans 8589940056 rc 0/0 00000100:00100000:0.0:1782487587.741413:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16339 00000100:00100000:2.0:1782487587.742267:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299239680 00000100:00100000:2.0:1782487587.742272:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299239680 00000100:00100000:0.0:1782487587.742280:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16345 00000100:00100000:0.0:1782487587.742289:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3317:x1869066299238912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.742301:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6110 count 1 00000100:00100000:2.0:1782487587.742304:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16346 00000100:00100000:2.0:1782487587.742313:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+43:3317:x1869066299239680:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.742317:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.742326:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6102 count 1 00010000:00010000:0.0:1782487587.742332:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 139 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742341:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17de:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.742342:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742346:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.742348:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487587.742355:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742358:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742381:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57976e800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.742383:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 118 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742386:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742389:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 139 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742407:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742414:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742415:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 139 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742425:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.742434:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.742444:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742446:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.742451:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299240064:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.742466:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029e0e1b0/0x66475b4e8b85e5a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742482:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742488:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1782487587.742490:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67c00 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.742495:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742499:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742507:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742511:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.742517:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742527:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.742530:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299240192:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.742534:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742545:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742551:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742553:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742564:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85e594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.742566:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.742576:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 118 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742583:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.742588:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742590:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742629:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.742635:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.742654:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299240320:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.742666:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.742671:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742678:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.742682:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742690:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742703:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742708:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742713:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f4deb66/0x66475b4e8b85e59b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.742716:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+44:3317:x1869066299236096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7628us (7760us total) trans 8589940057 rc 0/0 00000100:00100000:0.0:1782487587.742732:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16334 00010000:00010000:3.0:1782487587.742737:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742746:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85e5be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742746:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.742750:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.742755:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.742773:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.742776:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.742780:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.742794:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742805:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742814:0:190930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093710017/0x66475b4e8b850953 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745c2 expref: 139 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742816:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.742837:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.742840:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299237760:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.742859:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.742864:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742875:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742884:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742893:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742901:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.742917:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.743062:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3317:x1869066299236992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7654us (7756us total) trans 8589940058 rc 0/0 00000100:00100000:2.0:1782487587.743071:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16338 00010000:00010000:2.0:1782487587.743098:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.743103:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743111:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.743115:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743124:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743136:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743144:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ad96c5/0x66475b4e8b85e5b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743163:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.743167:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743174:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.743179:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743198:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743211:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743219:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e5a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.743238:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.743241:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.743245:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.743253:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.743287:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3314:x1869066299236864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7979us (8124us total) trans 8589940717 rc 0/0 00000100:00100000:3.0:1782487587.743296:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16336 00000100:00100000:2.0:1782487587.743318:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be480 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.743326:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.743335:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.743490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.743514:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409344 00000100:00100000:0.0:1782487587.743519:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409344 00010000:00010000:0.0:1782487587.743535:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 128 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.743547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:1.0:1782487587.743620:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711c00/2, rc 0, transno 8589940058 00000100:00100000:1.0:1782487587.743632:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236992:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.743647:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547710700/2, rc 0, transno 8589940057 00000100:00100000:1.0:1782487587.743650:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236096:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.743659:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547712680/2, rc 0, transno 8589940055 00000100:00100000:1.0:1782487587.743662:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299236224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.743671:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.743676:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299239552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.743698:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.743726:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299239552 00000100:00100000:1.0:1782487587.743729:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299239552 00000100:00100000:1.0:1782487587.743758:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16347 00000100:00100000:1.0:1782487587.743764:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3317:x1869066299239552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.743776:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6104 count 1 00010000:00010000:1.0:1782487587.743788:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.743804:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 118 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.743811:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.743815:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.743819:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.743837:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 118 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.743846:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 118 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.743856:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299240448:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.743875:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.743900:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299239296:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.743912:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.743931:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299239424:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.743940:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.743961:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299239936:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.743970:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744045:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299240576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.744071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.744103:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847100/2, rc 0, transno 8589940056 00000100:00100000:1.0:1782487587.744109:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299238144:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.744118:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711f80/2, rc 0, transno 8589940717 00000100:00100000:1.0:1782487587.744124:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299236864:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.744132:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547712d80/2, rc 0, transno 8589940716 00000100:00100000:1.0:1782487587.744135:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299236736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.744215:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299241088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.744239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.744255:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.744260:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299240960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.744275:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.744293:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299240576 00000100:00100000:1.0:1782487587.744296:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299240576 00000100:00100000:1.0:1782487587.744313:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299241088 00000100:00100000:1.0:1782487587.744316:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299241088 00000100:00100000:1.0:1782487587.744328:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299240960 00000100:00100000:1.0:1782487587.744330:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299240960 00000100:00100000:1.0:1782487587.744342:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16348 00000100:00100000:1.0:1782487587.744347:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3315:x1869066299240576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.744357:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6103 count 1 00010000:00010000:1.0:1782487587.744367:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744379:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 118 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744386:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d7:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.744388:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.744392:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744409:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 118 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744419:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 118 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744429:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299241344:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.744448:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.744462:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16349 00000100:00100000:1.0:1782487587.744469:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+43:3315:x1869066299241088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.744480:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6115 count 1 00010000:00010000:1.0:1782487587.744490:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744501:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 128 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744507:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.744510:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.744513:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744529:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 128 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744538:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 128 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744546:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299241472:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.744564:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.744577:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350 00000100:00100000:1.0:1782487587.744583:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3315:x1869066299240960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.744592:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6107 count 1 00010000:00010000:1.0:1782487587.744603:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744637:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 118 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744651:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 97 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744657:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17db:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.744660:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.744664:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744681:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 97 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744690:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 97 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744699:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299241600:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.744723:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 118 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744732:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744741:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299241728:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.744758:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.744796:0:213223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a580cfd/0x66475b4e8b850b52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4746be expref: 128 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.744808:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547712300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299236480:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.744821:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744830:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744838:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744845:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744852:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.744864:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.744999:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3316:x1869066299235584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10920us (11062us total) trans 8589940718 rc 0/0 00000100:00100000:1.0:1782487587.745006:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16331 00010000:00010000:1.0:1782487587.745022:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.745026:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745039:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.745042:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745050:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745062:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745069:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d8682a/0x66475b4e8b85e586 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745082:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.745084:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.745085:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.745103:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85359f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47511b expref: 118 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.745112:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299237504:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.745124:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745132:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745138:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745146:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745154:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745166:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.745298:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:3317:x1869066299237248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9934us (10057us total) trans 8589940059 rc 0/0 00000100:00100000:1.0:1782487587.745304:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16337 00010000:00010000:1.0:1782487587.745321:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.745325:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745331:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.745334:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745340:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745350:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745357:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d684b05b/0x66475b4e8b85e5b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745370:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.745371:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.745372:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.745384:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299240704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.745408:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.745424:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299241216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.745441:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.745458:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5491c9880/2, rc 0, transno 8589940718 00000100:00100000:1.0:1782487587.745465:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5491c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299235584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.745472:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.745477:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299240832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.745494:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.745533:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299240704 00000100:00100000:1.0:1782487587.745536:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299240704 00000100:00100000:1.0:1782487587.745553:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299241216 00000100:00100000:1.0:1782487587.745555:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299241216 00000100:00100000:1.0:1782487587.745566:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299240832 00000100:00100000:1.0:1782487587.745568:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299240832 00000100:00100000:1.0:1782487587.745578:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16351 00000100:00100000:1.0:1782487587.745584:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3316:x1869066299240704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.745595:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6108 count 1 00010000:00010000:1.0:1782487587.745623:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745635:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745642:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.745645:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.745648:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745665:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745675:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.745684:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299241984:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.745706:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.745723:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16352 00000100:00100000:1.0:1782487587.745729:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+44:3316:x1869066299241216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.745740:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6116 count 1 00010000:00010000:1.0:1782487587.745749:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745760:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745772:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.745775:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.745778:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745793:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 127 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745803:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 127 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.745812:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299242112:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.745828:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447780 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.745846:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353 00000100:00100000:1.0:1782487587.745853:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3316:x1869066299240832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.745863:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6105 count 1 00010000:00010000:1.0:1782487587.745874:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745889:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 117 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745896:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d9:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.745899:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.745903:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745919:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 117 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.745928:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 117 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.745938:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299242240:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.745956:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.745974:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.745983:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299241856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.746005:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.746026:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299241856 00000100:00100000:1.0:1782487587.746030:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299241856 00000100:00100000:0.0:1782487587.746031:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409472 00000100:00100000:0.0:1782487587.746038:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409472 00000100:00100000:1.0:1782487587.746052:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354 00010000:00010000:0.0:1782487587.746061:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 139 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.746062:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3316:x1869066299241856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.746078:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6117 count 1 00010000:00010000:1.0:1782487587.746091:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.746102:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6224 00000100:00100000:3.0:1782487587.746105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.746111:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 127 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.746116:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+127:2363:x1869066294409344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.746123:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.746128:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746131:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.746132:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746141:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 127 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746154:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 127 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746157:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 127 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746163:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409600 00000100:00100000:2.0:1782487587.746169:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409600 00010000:00010000:1.0:1782487587.746180:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 128 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746198:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a133f67/0x66475b4e8b850eee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47474a expref: 128 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746200:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 128 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.746209:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299242368:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.746214:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746219:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746224:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746232:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746236:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6225 00000100:00100000:2.0:1782487587.746247:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+139:2363:x1869066294409472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.746256:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.746256:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.746261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.746266:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 139 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.746266:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299238784:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.746278:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 139 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746284:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746295:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d38f9bc6/0x66475b4e8b850a79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474616 expref: 139 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746295:0:213221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e038bd/0x66475b4e8b8509bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4745d7 expref: 139 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.746321:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299238528:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.746322:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746324:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.746329:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.746335:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746343:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746344:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.746352:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+127:2363:x1869066294409344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 237us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.746366:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6224 00010000:00010000:1.0:1782487587.746368:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746377:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746379:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.746381:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409728 00000100:00100000:0.0:1782487587.746385:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409728 00010000:00010000:1.0:1782487587.746396:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746402:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2363:x1869066294409472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 156us (2855us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.746403:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 98 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746413:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746418:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6225 00000100:00100000:0.0:1782487587.746433:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6226 00000100:00100000:2.0:1782487587.746436:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6227 00010000:00010000:1.0:1782487587.746440:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.746440:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+126:2363:x1869066294409600:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.746444:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2361:x1869066294409728:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.746445:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.746452:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.746454:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746455:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.746458:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 126 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746461:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 98 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.746478:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.746483:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746485:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 98 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746485:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 126 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746513:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f122a728/0x66475b4e8b853cad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475313 expref: 98 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.746522:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746525:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.746532:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.746539:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.746543:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746550:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.746555:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077261c40/0x66475b4e8b85e5c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.746579:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3314:x1869066299238272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10085us (10517us total) trans 8589940719 rc 0/0 00010000:00010000:3.0:1782487587.746580:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.746581:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.746584:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.746589:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.746592:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16340 00010000:00010000:1.0:1782487587.746631:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746635:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2361:x1869066294409728:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 189us (377us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.746647:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746652:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6227 00010000:00010000:1.0:1782487587.746661:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746669:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746682:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746687:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.746701:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746710:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746726:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746737:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008187207e/0x66475b4e8b8511cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474815 expref: 126 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746744:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.746751:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746753:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.746758:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746766:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.746785:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.746808:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+125:2363:x1869066294409600:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 369us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.746816:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6226 00000100:00100000:1.0:1782487587.746831:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3315:x1869066299239168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7547us (7765us total) trans 8589940720 rc 0/0 00000100:00100000:1.0:1782487587.746842:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16342 00010000:00010000:1.0:1782487587.746869:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746877:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746886:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.746894:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.746902:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3315:x1869066299239040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7375us (7765us total) trans 8589940721 rc 0/0 00000100:00100000:2.0:1782487587.746910:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16343 00010000:00010000:1.0:1782487587.746910:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782487587.746933:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.746938:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746946:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.746949:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746957:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746969:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746977:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cb3f43/0x66475b4e8b85e5d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.746991:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.746994:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747001:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.747004:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747011:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747022:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747029:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e06ff66/0x66475b4e8b85e5da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747045:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.747047:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747053:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.747057:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747064:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747073:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.747081:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3315:x1869066299239808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6948us (7038us total) trans 8589940722 rc 0/0 00010000:00010000:2.0:1782487587.747083:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80992e4/0x66475b4e8b85e5e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.747096:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16344 00010000:00010000:2.0:1782487587.747102:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.747105:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.747107:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.747115:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747119:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.747125:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747134:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747141:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.747145:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549166a00/2, rc 0, transno 8589940722 00000100:00100000:1.0:1782487587.747159:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.747160:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782487587.747178:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549164700/2, rc 0, transno 8589940721 00000100:00100000:1.0:1782487587.747183:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239040:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.747207:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549166680/2, rc 0, transno 8589940720 00000100:00100000:1.0:1782487587.747212:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299239168:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.747277:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299242624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.747305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.747325:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.747332:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299242496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.747341:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+49:3316:x1869066299238656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8547us (8617us total) trans 8589940060 rc 0/0 00000100:00100000:2.0:1782487587.747349:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341 00000100:00100000:1.0:1782487587.747372:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.747415:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547713480/2, rc 0, transno 8589940719 00000100:00100000:1.0:1782487587.747425:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299238272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.747446:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299242624 00000100:00100000:2.0:1782487587.747451:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299242624 00000100:00100000:1.0:1782487587.747461:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299242496 00000100:00100000:1.0:1782487587.747465:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299242496 00000100:00100000:2.0:1782487587.747481:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16355 00000100:00100000:2.0:1782487587.747489:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+47:3315:x1869066299242624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.747504:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6118 count 1 00000100:00100000:1.0:1782487587.747504:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16356 00000100:00100000:1.0:1782487587.747514:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+47:3315:x1869066299242496:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.747519:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.747527:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6119 count 1 00010000:00010000:2.0:1782487587.747534:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 124 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747541:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747544:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.747552:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.747559:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747561:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 124 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747578:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e7:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.747581:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.747586:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747593:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 124 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.747599:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.747623:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.747632:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 124 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747640:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 124 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.747662:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 124 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.747667:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299243008:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.747680:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299243136:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.747708:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.747709:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.747727:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.747733:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.747744:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.747758:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.747761:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299242752:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.747778:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70cbf67/0x66475b4e8b85e5cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.747792:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.747801:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.747805:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.747808:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.747819:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.747827:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847800/2, rc 0, transno 8589940060 00000100:00100000:1.0:1782487587.747839:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299238656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.747851:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.747859:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299242880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.747886:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.747948:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299242752 00000100:00100000:1.0:1782487587.747952:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299242752 00000100:00100000:1.0:1782487587.747974:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299242880 00000100:00100000:1.0:1782487587.747977:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299242880 00000100:00100000:1.0:1782487587.747999:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16357 00000100:00100000:1.0:1782487587.748007:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3316:x1869066299242752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.748017:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6120 count 1 00010000:00010000:1.0:1782487587.748030:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748042:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 136 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748049:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.748053:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.748058:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748076:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 136 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748087:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 136 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.748098:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299243392:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.748131:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.748153:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16358 00000100:00100000:1.0:1782487587.748162:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3316:x1869066299242880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.748173:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6121 count 1 00010000:00010000:1.0:1782487587.748198:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748210:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 136 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748218:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.748222:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.748226:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748246:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 136 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748258:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 136 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.748269:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299243520:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.748304:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.748325:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299243264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.748353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.748387:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299243264 00000100:00100000:1.0:1782487587.748390:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299243264 00000100:00100000:1.0:1782487587.748411:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16359 00000100:00100000:1.0:1782487587.748418:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3314:x1869066299243264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.748430:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6110 count 1 00010000:00010000:1.0:1782487587.748443:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748454:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 117 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748462:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17de:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.748465:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.748469:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748488:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 117 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748499:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 117 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.748510:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299243648:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.748540:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.748604:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547712a00/2, rc 0, transno 8589940059 00000100:00100000:1.0:1782487587.748638:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299237248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.748685:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.748694:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299243776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.748721:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.748762:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299243776 00000100:00100000:1.0:1782487587.748765:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299243776 00000100:00100000:1.0:1782487587.748794:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16360 00000100:00100000:1.0:1782487587.748802:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3314:x1869066299243776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.748812:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6111 count 1 00010000:00010000:1.0:1782487587.748824:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748837:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 96 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748845:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17df:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.748848:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.748853:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748872:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 96 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.748883:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 96 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.748894:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299243904:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.748934:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.753464:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299240192:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.753483:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299240064:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.753487:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299240320:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.753520:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.753521:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.753582:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299240448:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.753602:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.753666:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299241344:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.753674:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.753684:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.753699:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409984 00000100:00100000:3.0:1782487587.753705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.753707:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409984 00000100:00100000:0.0:1782487587.753727:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410240 00000100:00100000:0.0:1782487587.753731:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410240 00000100:00100000:1.0:1782487587.753737:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299241472:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.753741:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.753742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.753749:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 118 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.753759:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.753773:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.753776:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410624 00000100:00100000:2.0:1782487587.753780:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410624 00000100:00100000:0.0:1782487587.753781:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6228 00000100:00100000:0.0:1782487587.753789:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2362:x1869066294409984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.753796:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 119 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.753799:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299241600:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.753802:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.753807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.753810:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.753821:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299241728:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.753823:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294409856 00010000:00010000:0.0:1782487587.753824:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.753828:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294409856 00000100:00100000:3.0:1782487587.753841:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.753844:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 137 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.753847:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.753849:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ddf5cb7/0x66475b4e8b854161 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475455 expref: 97 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.753863:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410112 00000100:00100000:2.0:1782487587.753868:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410112 00000100:00100000:3.0:1782487587.753870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.753884:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.753888:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.753894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.753902:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410496 00000100:00100000:2.0:1782487587.753906:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410496 00000100:00100000:1.0:1782487587.753911:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299242112:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.753921:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 125 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.753926:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.753932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.753939:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2362:x1869066294409984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 147us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.753942:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410880 00000100:00100000:2.0:1782487587.753944:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410880 00000100:00100000:0.0:1782487587.753947:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6228 00010000:00010000:2.0:1782487587.753957:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 121 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.753964:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411136 00000100:00100000:2.0:1782487587.753968:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410368 00000100:00100000:1.0:1782487587.753968:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299241984:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.753968:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411136 00000100:00100000:2.0:1782487587.753972:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410368 00010000:00010000:0.0:1782487587.753983:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 123 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.753985:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 123 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.753986:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754009:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6229 00000100:00100000:3.0:1782487587.754014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.754019:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6230 00000100:00100000:0.0:1782487587.754021:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2362:x1869066294410240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.754027:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2362:x1869066294410624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.754029:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.754031:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299242240:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.754036:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.754036:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.754039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.754045:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 123 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754054:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754055:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754056:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 123 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.754062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.754088:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbce99b/0x66475b4e8b853f07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753ad expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754089:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccd7b7ad/0x66475b4e8b853f5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753de expref: 123 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754099:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.754099:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754103:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754108:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.754118:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299242368:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.754119:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754132:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2362:x1869066294410624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 106us (396us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.754135:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754141:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6230 00010000:00010000:0.0:1782487587.754143:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.754155:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411008 00000100:00100000:2.0:1782487587.754159:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411008 00000100:00100000:0.0:1782487587.754161:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2362:x1869066294410240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (457us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.754167:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754168:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6229 00010000:00010000:2.0:1782487587.754171:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 126 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754181:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294410752 00000100:00100000:0.0:1782487587.754184:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294410752 00010000:00010000:1.0:1782487587.754203:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754208:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411264 00010000:00010000:0.0:1782487587.754211:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754212:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411264 00010000:00010000:1.0:1782487587.754222:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754223:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 127 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754231:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6231 00000100:00100000:0.0:1782487587.754240:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2362:x1869066294409856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.754247:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754250:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.754255:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6232 00010000:00010000:0.0:1782487587.754258:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 137 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754264:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2362:x1869066294410112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.754273:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 137 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754274:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.754278:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 119 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754286:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.754287:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 119 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754290:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085106ea3/0x66475b4e8b850a6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474601 expref: 137 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754302:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc6fd23c/0x66475b4e8b853a30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47526b expref: 119 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754306:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754309:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754311:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754313:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754313:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754318:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754321:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754326:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754338:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.754347:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.754359:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2362:x1869066294409856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.754361:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2362:x1869066294410112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 99us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.754366:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6231 00000100:00100000:2.0:1782487587.754370:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6232 00010000:00010000:3.0:1782487587.754381:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754386:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6233 00000100:00100000:2.0:1782487587.754396:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6234 00000100:00100000:0.0:1782487587.754397:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+127:2362:x1869066294410496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.754403:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2362:x1869066294410880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.754404:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.754409:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.754409:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 127 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754414:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754419:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 127 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754424:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754432:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea05b7bd/0x66475b4e8b8511db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474823 expref: 127 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754441:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b32e2fcf/0x66475b4e8b853f0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753b4 expref: 117 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754449:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754450:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754452:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754453:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754456:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754458:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.754460:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754471:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754474:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.754482:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.754489:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754495:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.754495:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.754503:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.754517:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2362:x1869066294410880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 113us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.754517:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+126:2362:x1869066294410496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 122us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.754525:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6234 00000100:00100000:0.0:1782487587.754533:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6233 00000100:00100000:2.0:1782487587.754543:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6235 00000100:00100000:2.0:1782487587.754551:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2362:x1869066294411136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.754557:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.754562:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 115 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754574:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6236 00010000:00010000:2.0:1782487587.754576:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 115 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.754576:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+51:3317:x1869066299239552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10806us (10870us total) trans 8589940061 rc 0/0 00000100:00100000:0.0:1782487587.754582:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2361:x1869066294410368:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.754594:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.754596:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16347 00010000:00010000:0.0:1782487587.754601:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 115 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754605:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74a8d28/0x66475b4e8b853f54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d0 expref: 115 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754638:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 115 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754641:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754645:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754650:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754653:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1aae4ea/0x66475b4e8b853a4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475279 expref: 114 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754657:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.754658:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754666:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754674:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.754677:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.754679:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754680:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.754684:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754685:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.754693:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+51:3317:x1869066299239680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12378us (14234us total) trans 8589940062 rc 0/0 00000100:00100000:2.0:1782487587.754702:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2362:x1869066294411136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 151us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.754711:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16346 00010000:00010000:1.0:1782487587.754711:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754712:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6235 00010000:00010000:0.0:1782487587.754712:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754729:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6237 00000100:00100000:2.0:1782487587.754739:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+125:2361:x1869066294411008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.754742:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754742:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.754747:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.754755:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021667da5/0x66475b4e8b85e5f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754756:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 125 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754762:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2361:x1869066294410368:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.754776:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6236 00010000:00010000:2.0:1782487587.754781:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 125 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754790:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.754795:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754795:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6238 00010000:00010000:2.0:1782487587.754799:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007382606b/0x66475b4e8b85139b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a1 expref: 125 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754806:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2361:x1869066294410752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.754815:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.754817:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.754821:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754821:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754823:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754825:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.754833:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754840:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754848:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754849:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754854:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a7e59ca/0x66475b4e8b854574 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475582 expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754875:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754878:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.754878:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.754886:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.754891:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352bf9ea/0x66475b4e8b85e5ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.754893:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754902:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+124:2361:x1869066294411008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 164us (890us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.754912:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.754913:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6237 00010000:00010000:1.0:1782487587.754918:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.754922:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.754925:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.754928:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.754930:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6239 00000100:00100000:2.0:1782487587.754937:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2361:x1869066294411264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.754938:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.754945:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.754947:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294410752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (911us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.754952:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 123 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754958:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.754959:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6238 00010000:00010000:2.0:1782487587.754967:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 123 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754973:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.754992:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755001:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae95e84/0x66475b4e8b851394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4748a8 expref: 123 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755009:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.755017:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.755020:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.755025:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755032:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.755044:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.755049:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755051:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.755057:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.755061:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.755067:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.755074:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2361:x1869066294411264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (1013us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.755081:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.755082:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6239 00010000:00010000:3.0:1782487587.755090:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009954e5b5/0x66475b4e8b85e5fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.755108:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.755112:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.755115:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.755125:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.755137:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755145:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755153:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755165:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755180:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.755210:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3315:x1869066299240576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10861us (11136us total) trans 8589940063 rc 0/0 00000100:00100000:1.0:1782487587.755218:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16348 00010000:00010000:1.0:1782487587.755241:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755249:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755257:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755265:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755279:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.755373:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+50:3316:x1869066299241216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9643us (9930us total) trans 8589940723 rc 0/0 00000100:00100000:2.0:1782487587.755381:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16352 00010000:00010000:2.0:1782487587.755404:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755413:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755421:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755427:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.755436:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+50:3315:x1869066299241088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10964us (11192us total) trans 8589940724 rc 0/0 00000100:00100000:1.0:1782487587.755445:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16349 00010000:00010000:2.0:1782487587.755452:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.755470:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755477:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755484:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755489:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755501:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1782487587.755592:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3316:x1869066299240704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10007us (10183us total) trans 8589940064 rc 0/0 00000100:00100000:2.0:1782487587.755598:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16351 00010000:00010000:2.0:1782487587.755638:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755652:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755661:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755667:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755676:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1782487587.755714:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3317:x1869066299238912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13424us (15307us total) trans 8589940725 rc 0/0 00000100:00100000:1.0:1782487587.755722:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16345 00010000:00010000:1.0:1782487587.755746:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782487587.755752:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755761:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.755766:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755775:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755789:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.755792:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3316:x1869066299240832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9939us (10296us total) trans 8589940065 rc 0/0 00000100:00100000:2.0:1782487587.755807:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353 00010000:00010000:1.0:1782487587.755808:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009373c8c/0x66475b4e8b85e619 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755822:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782487587.755828:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755829:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.755835:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755841:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.755844:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce0c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.755847:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755849:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755869:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755869:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755888:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755892:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755894:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000341af03b/0x66475b4e8b85e612 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755914:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081134fa8/0x66475b4e8b85e604 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755921:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.755925:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755929:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.755930:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.755932:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755935:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755943:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755946:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5476fd000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.755953:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755957:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755967:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755967:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3e4dad/0x66475b4e8b85e5e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.755993:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.755998:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.756001:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed2c1356/0x66475b4e8b85e620 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756002:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756005:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756019:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.756021:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.756024:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.756027:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756028:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.756038:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756039:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756059:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.756076:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756085:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.756086:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.756096:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.756108:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.756291:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3315:x1869066299240960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11706us (12013us total) trans 8589940066 rc 0/0 00000100:00100000:1.0:1782487587.756300:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350 00010000:00010000:3.0:1782487587.756311:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.756317:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756324:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.756325:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a1ce1000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.756331:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756332:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.756350:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756351:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.756359:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.756365:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756370:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.756376:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89af989/0x66475b4e8b85e60b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756389:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.756393:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.756396:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.756399:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756400:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e627 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756425:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756428:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756432:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.756440:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.756474:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549164000/2, rc 0, transno 8589940066 00000100:00100000:1.0:1782487587.756489:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299240960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.756567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.756623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.756672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:1.0:1782487587.756686:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d78700/2, rc 0, transno 8589940724 00000100:00100000:3.0:1782487587.756695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.756701:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299241088:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.756718:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549165180/2, rc 0, transno 8589940063 00000100:00100000:3.0:1782487587.756723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.756727:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299240576:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.756750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.756833:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3316:x1869066299241856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10772us (10825us total) trans 8589940726 rc 0/0 00000100:00100000:2.0:1782487587.756841:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354 00000100:00100000:1.0:1782487587.756847:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299243520:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.756867:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.756877:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299243008:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.756895:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.756901:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299243648:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.756920:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.756924:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411520 00000100:00100000:2.0:1782487587.756930:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411520 00000100:00100000:1.0:1782487587.756952:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299243392:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.756955:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 122 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.756969:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.756993:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.757030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.757075:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.757076:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411392 00000100:00100000:0.0:1782487587.757076:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411776 00000100:00100000:2.0:1782487587.757081:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411392 00000100:00100000:0.0:1782487587.757082:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411776 00010000:00010000:2.0:1782487587.757097:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 123 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757097:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 136 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.757111:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411904 00000100:00100000:0.0:1782487587.757111:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294411648 00000100:00100000:2.0:1782487587.757114:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411904 00000100:00100000:0.0:1782487587.757114:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294411648 00010000:00010000:2.0:1782487587.757124:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 112 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757124:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 137 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.757136:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412032 00000100:00100000:2.0:1782487587.757138:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412032 00000100:00100000:0.0:1782487587.757138:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6240 00000100:00100000:0.0:1782487587.757143:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2360:x1869066294411520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.757148:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 95 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757153:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.757158:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 123 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.757161:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6241 00000100:00100000:2.0:1782487587.757167:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2360:x1869066294411776:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.757169:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 123 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757174:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.757176:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.757180:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 137 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757201:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757202:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 137 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757206:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.757211:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757217:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b8519bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aa0 expref: 137 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757219:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.757223:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7b100/2, rc 0, transno 8589940726 00010000:00010000:2.0:1782487587.757228:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757232:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757237:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757237:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.757238:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299241856:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.757250:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.757257:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549164e00/2, rc 0, transno 8589940065 00010000:00010000:2.0:1782487587.757265:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.757266:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+123:2360:x1869066294411520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 121us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.757275:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6240 00000100:00100000:2.0:1782487587.757280:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2360:x1869066294411776:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 114us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.757286:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6241 00000100:00100000:0.0:1782487587.757290:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6242 00000100:00100000:2.0:1782487587.757296:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6243 00000100:00100000:0.0:1782487587.757296:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2360:x1869066294411392:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.757300:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2360:x1869066294411648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.757303:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.757306:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.757308:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 122 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757310:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 135 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757320:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 135 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757320:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 122 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.757331:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299240832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.757332:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b19e0f8a/0x66475b4e8b8519d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474aae expref: 135 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757337:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb9305b9/0x66475b4e8b851500 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474918 expref: 122 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757348:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.757348:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757352:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.757352:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1782487587.757354:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549166d80/2, rc 0, transno 8589940064 00010000:00010000:2.0:1782487587.757357:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757358:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.757361:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299240704:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.757373:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757377:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.757378:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7a680/2, rc 0, transno 8589940723 00000100:00100000:1.0:1782487587.757387:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299241216:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.757390:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.757396:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.757400:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.757410:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.757412:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2360:x1869066294411648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 109us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.757412:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+121:2360:x1869066294411392:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 113us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.757422:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6243 00000100:00100000:0.0:1782487587.757426:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6242 00000100:00100000:2.0:1782487587.757435:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6244 00000100:00100000:2.0:1782487587.757442:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2360:x1869066294411904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.757450:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.757454:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.757457:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6245 00010000:00010000:2.0:1782487587.757459:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 112 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.757463:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2360:x1869066294412032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.757471:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 112 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757471:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.757475:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 95 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757485:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4f658e5/0x66475b4e8b8542b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b7 expref: 112 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757485:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 95 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757497:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757500:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.757503:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757504:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.757507:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.757511:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757518:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757519:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.757531:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.757536:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.757549:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2360:x1869066294411904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 107us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.757549:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2360:x1869066294412032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 85us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.757557:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6245 00000100:00100000:2.0:1782487587.757563:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6244 00010000:00010000:2.0:1782487587.757579:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757589:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757599:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757627:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757632:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757642:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.757644:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757654:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757661:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757682:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.757795:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+50:3315:x1869066299242624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10307us (10489us total) trans 8589940727 rc 0/0 00000100:00100000:2.0:1782487587.757802:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16355 00000100:00100000:2.0:1782487587.757815:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244288 00000100:00100000:2.0:1782487587.757818:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244288 00000100:00100000:2.0:1782487587.757841:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244032 00000100:00100000:2.0:1782487587.757843:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244032 00000100:00100000:2.0:1782487587.757859:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244160 00000100:00100000:2.0:1782487587.757861:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244160 00000100:00100000:2.0:1782487587.757880:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16361 00000100:00100000:2.0:1782487587.757887:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+51:3314:x1869066299244288:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.757893:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3316:x1869066299242880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9731us (10005us total) trans 8589940728 rc 0/0 00000100:00100000:1.0:1782487587.757903:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16358 00002000:00080000:2.0:1782487587.757904:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6122 count 1 00010000:00010000:2.0:1782487587.757921:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.757925:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16362 00010000:00010000:2.0:1782487587.757942:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 133 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.757942:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3316:x1869066299244032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.757955:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1782487587.757958:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.757961:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6109 count 1 00010000:00010000:2.0:1782487587.757962:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757978:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.757985:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 133 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.757993:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 110 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758002:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 133 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758004:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.758012:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.758019:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.758021:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299244928:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.758049:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 110 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758060:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 110 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.758064:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.758081:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299245056:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.758090:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16363 00000100:00100000:2.0:1782487587.758097:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+52:3316:x1869066299244160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.758109:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6112 count 1 00010000:00010000:2.0:1782487587.758119:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758130:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758138:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e0:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.758140:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.758144:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758167:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758175:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.758184:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.758186:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299245184:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.758220:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.758231:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.758235:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758238:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758254:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758255:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.758263:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758277:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758295:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758297:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758313:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.758319:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758327:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e62e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758346:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.758350:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758357:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.758362:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758370:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758381:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758389:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006556fe8b/0x66475b4e8b85e643 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758407:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.758411:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758419:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c464800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.758423:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.758430:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3316:x1869066299242752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10423us (10639us total) trans 8589940729 rc 0/0 00010000:00010000:1.0:1782487587.758434:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.758440:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16357 00010000:00010000:1.0:1782487587.758453:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.758458:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.758464:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001576e4f9/0x66475b4e8b85e63c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758484:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.758488:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.758491:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.758501:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.758515:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758524:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758534:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758542:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.758559:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.758769:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3314:x1869066299243264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10349us (10415us total) trans 8589940067 rc 0/0 00000100:00100000:1.0:1782487587.758778:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16359 00000100:00100000:1.0:1782487587.758814:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.758844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.758876:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770ea00/2, rc 0, transno 8589940067 00000100:00100000:1.0:1782487587.758886:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299243264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.758897:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.758905:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.758931:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.758979:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.758985:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.758993:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.758996:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.759005:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.759005:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244800 00000100:00100000:1.0:1782487587.759010:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244800 00010000:00010000:3.0:1782487587.759021:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.759028:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a68fb442/0x66475b4e8b85e64a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.759038:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244416 00010000:00010000:3.0:1782487587.759042:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.759043:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244416 00010000:00010000:3.0:1782487587.759045:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.759048:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.759229:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16364 00000100:00100000:1.0:1782487587.759237:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16365 00000100:00100000:2.0:1782487587.759239:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+51:3314:x1869066299244800:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.759250:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3314:x1869066299244416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.759253:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6129 count 1 00010000:00010000:2.0:1782487587.759266:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.759267:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6113 count 1 00010000:00010000:2.0:1782487587.759282:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759286:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.759294:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f1:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.759301:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.759306:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759308:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 94 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759330:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e1:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.759335:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.759339:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.759343:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.759361:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.759370:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299245440:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.759374:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 94 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759387:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 94 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.759398:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299245568:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.759649:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.759650:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.759675:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299245312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.759708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.759743:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549167800/2, rc 0, transno 8589940727 00000100:00100000:1.0:1782487587.759754:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299242624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.759864:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299245312 00000100:00100000:1.0:1782487587.759868:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299245312 00000100:00100000:1.0:1782487587.759905:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16366 00000100:00100000:1.0:1782487587.759915:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3315:x1869066299245312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.759928:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6114 count 1 00010000:00010000:1.0:1782487587.759942:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759956:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 110 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759963:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.759966:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.759971:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.759992:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 110 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760003:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 110 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.760021:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299245824:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.760050:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447780 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.760174:0:213223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6e2e03b/0x66475b4e8b851507 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47490a expref: 120 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.760200:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299243136:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.760223:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760232:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760240:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760249:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760256:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760273:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.760447:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3315:x1869066299242496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12934us (13075us total) trans 8589940730 rc 0/0 00000100:00100000:1.0:1782487587.760456:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16356 00010000:00010000:1.0:1782487587.760478:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.760484:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760493:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54c464200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.760498:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760507:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760522:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760530:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c053e2/0x66475b4e8b85e635 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760550:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.760552:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.760555:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.760578:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79500/2, rc 0, transno 8589940730 00000100:00100000:1.0:1782487587.760588:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299242496:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.760657:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85441d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47550b expref: 94 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.760676:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299243904:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.760692:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760701:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760709:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760718:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760726:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760741:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.760923:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+55:3314:x1869066299243776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12121us (12201us total) trans 8589940068 rc 0/0 00000100:00100000:1.0:1782487587.760933:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16360 00010000:00010000:1.0:1782487587.760955:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.760960:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760975:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.760980:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.760989:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761004:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761011:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e651 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761031:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.761033:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.761037:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.761059:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770c380/2, rc 0, transno 8589940068 00000100:00100000:1.0:1782487587.761069:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299243776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.761130:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299246080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.761158:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.761223:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299246080 00000100:00100000:1.0:1782487587.761227:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299246080 00000100:00100000:1.0:1782487587.761254:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16367 00000100:00100000:1.0:1782487587.761261:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3314:x1869066299246080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.761277:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6116 count 1 00010000:00010000:1.0:1782487587.761291:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761304:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 110 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761312:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e4:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.761316:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.761321:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761342:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 110 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761353:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 110 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.761365:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299246208:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.761410:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.761427:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299244928:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.761445:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.761469:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299245056:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.761486:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.761507:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.761528:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.764014:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.764053:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299245696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.764085:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.764113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.764121:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244544 00000100:00100000:1.0:1782487587.764127:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244544 00000100:00100000:2.0:1782487587.764152:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299245696 00000100:00100000:2.0:1782487587.764157:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299245696 00000100:00100000:1.0:1782487587.764158:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16368 00000100:00100000:1.0:1782487587.764168:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3316:x1869066299244544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.764186:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6115 count 1 00000100:00100000:2.0:1782487587.764204:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16369 00000100:00100000:2.0:1782487587.764212:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3316:x1869066299245696:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.764216:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.764226:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6131 count 1 00010000:00010000:1.0:1782487587.764233:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 110 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764240:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764243:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.764250:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.764256:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764265:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 133 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764274:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.764278:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 110 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764279:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.764288:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764292:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 110 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764313:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299246336:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.764322:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 133 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764334:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 133 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764342:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.764347:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299246464:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.764364:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299244672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.764373:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412288 00000100:00100000:0.0:1782487587.764377:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412288 00000100:00100000:3.0:1782487587.764387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.764391:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.764401:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 134 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764411:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299245952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.764426:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412160 00000100:00100000:0.0:1782487587.764431:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412160 00000100:00100000:1.0:1782487587.764436:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.764444:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 111 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.764460:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549165f80/2, rc 0, transno 8589940061 00000100:00100000:0.0:1782487587.764467:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6246 00000100:00100000:1.0:1782487587.764470:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299239552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.764478:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2360:x1869066294412288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.764479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:1.0:1782487587.764482:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549165500/2, rc 0, transno 8589940725 00010000:00010000:0.0:1782487587.764487:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.764491:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299238912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.764497:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 134 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.764501:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549165c00/2, rc 0, transno 8589940062 00000100:00100000:1.0:1782487587.764507:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299239680:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.764517:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 134 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.764536:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7396329/0x66475b4e8b8519fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474ab5 expref: 134 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.764551:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.764555:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.764561:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764572:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299246592:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.764572:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.764600:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.764652:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299244672 00000100:00100000:1.0:1782487587.764655:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299244672 00000100:00100000:1.0:1782487587.764668:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299245952 00000100:00100000:1.0:1782487587.764669:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299245952 00000100:00100000:1.0:1782487587.764680:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299246592 00000100:00100000:1.0:1782487587.764682:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299246592 00000100:00100000:1.0:1782487587.764692:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370 00000100:00100000:1.0:1782487587.764697:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3317:x1869066299244672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.764707:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6123 count 1 00010000:00010000:1.0:1782487587.764717:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.764728:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.764730:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 133 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764740:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17eb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782487587.764744:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.764745:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412416 00010000:00010000:1.0:1782487587.764748:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.764751:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412416 00010000:00010000:2.0:1782487587.764772:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764776:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 133 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764793:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 133 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.764803:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6247 00000100:00100000:1.0:1782487587.764805:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299246976:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.764814:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2360:x1869066294412160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.764823:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.764828:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 111 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764831:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.764843:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 111 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.764855:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16371 00000100:00100000:1.0:1782487587.764866:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+54:3317:x1869066299245952:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.764871:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2516faf/0x66475b4e8b8542f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754be expref: 111 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.764876:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2360:x1869066294412288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 401us (764us total) trans 0 rc 0/0 00002000:00080000:1.0:1782487587.764880:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6125 count 1 00010000:00010000:2.0:1782487587.764883:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.764886:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17dd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.764889:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6246 00010000:00010000:1.0:1782487587.764892:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.764893:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.764908:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6248 00010000:00010000:2.0:1782487587.764914:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764916:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 132 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.764918:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294412416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.764930:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.764935:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ed:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.764938:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764939:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.764943:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.764944:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.764964:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+110:2360:x1869066294412160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 153us (577us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.764968:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.764971:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 132 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.764972:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6247 00010000:00010000:1.0:1782487587.764989:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 132 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.764992:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.764996:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16372 00010000:00010000:0.0:1782487587.764999:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e0:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.765005:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299247104:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.765006:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3315:x1869066299246592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.765006:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.765016:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.765022:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6120 count 1 00000100:00100000:1.0:1782487587.765027:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.765030:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.765035:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765047:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 94 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.765051:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294412416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.765053:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299246848:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.765055:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.765061:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.765063:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6248 00010000:00010000:2.0:1782487587.765065:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765085:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.765086:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 93 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765097:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 93 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765102:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.765110:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299246720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.765112:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299247232:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.765135:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.765143:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.765170:0:213384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3284bdf/0x66475b4e8b85477a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47565b expref: 93 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765172:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299246848 00000100:00100000:1.0:1782487587.765178:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299246848 00000100:00100000:2.0:1782487587.765186:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299245184:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.765213:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765216:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299246720 00000100:00100000:1.0:1782487587.765222:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299246720 00010000:00010000:2.0:1782487587.765225:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765233:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765246:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373 00010000:00010000:2.0:1782487587.765247:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765258:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765258:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+55:3317:x1869066299246848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.765282:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6130 count 1 00010000:00010000:2.0:1782487587.765287:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.765297:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765310:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 132 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765316:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.765319:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.765322:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765343:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 132 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765352:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 132 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765362:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299247360:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.765388:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.765408:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16374 00000100:00100000:1.0:1782487587.765418:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3317:x1869066299246720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.765431:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6122 count 1 00010000:00010000:1.0:1782487587.765445:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765463:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 92 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765470:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ea:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.765474:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.765478:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.765502:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+59:3316:x1869066299244160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7403us (8054us total) trans 8589940069 rc 0/0 00010000:00010000:1.0:1782487587.765503:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 92 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.765516:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16363 00010000:00010000:1.0:1782487587.765523:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 92 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765535:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299247488:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.765550:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765560:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.765562:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447e40 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.765573:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765581:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765598:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1782487587.765678:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770d500/2, rc 0, transno 8589940069 00000100:00100000:1.0:1782487587.765690:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244160:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.765702:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.765708:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765717:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.765721:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765732:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.765747:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+56:3314:x1869066299244288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7859us (8714us total) trans 8589940731 rc 0/0 00010000:00010000:1.0:1782487587.765748:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.765767:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16361 00010000:00010000:1.0:1782487587.765768:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a6bdf05/0x66475b4e8b85e666 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765790:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.765795:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765799:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765804:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.765810:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765812:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765833:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765835:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765856:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765860:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.765868:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.765870:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e658 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765896:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.765900:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765907:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025b600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.765911:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765920:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765932:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765940:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2625cda/0x66475b4e8b85e65f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.765962:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.765965:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.765968:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.765981:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3316:x1869066299244032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8045us (8807us total) trans 8589940070 rc 0/0 00000100:00100000:2.0:1782487587.765988:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16362 00010000:00010000:1.0:1782487587.766024:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.766038:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.766048:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299247616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.766098:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.766152:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770c700/2, rc 0, transno 8589940731 00000100:00100000:1.0:1782487587.766163:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.766229:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.766239:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299247744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.766271:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.766291:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299247616 00000100:00100000:2.0:1782487587.766296:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299247616 00000100:00100000:2.0:1782487587.766317:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299247744 00000100:00100000:2.0:1782487587.766320:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299247744 00000100:00100000:1.0:1782487587.766328:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16375 00000100:00100000:1.0:1782487587.766339:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3315:x1869066299247616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.766345:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16376 00000100:00100000:2.0:1782487587.766354:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+56:3314:x1869066299247744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.766354:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6123 count 1 00010000:00010000:1.0:1782487587.766370:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.766371:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6126 count 1 00010000:00010000:2.0:1782487587.766384:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766386:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 92 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766408:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17eb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.766415:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.766420:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 132 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766421:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.766436:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ee:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.766440:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.766445:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766455:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 92 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.766465:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 132 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766469:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 92 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.766484:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 132 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.766491:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299247872:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.766500:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299248000:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.766543:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.766543:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.766580:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770f800/2, rc 0, transno 8589940070 00000100:00100000:1.0:1782487587.766591:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.766654:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.766663:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299248128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.766697:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.766732:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299248128 00000100:00100000:1.0:1782487587.766736:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299248128 00000100:00100000:1.0:1782487587.766769:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377 00000100:00100000:1.0:1782487587.766777:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3317:x1869066299248128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.766790:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6118 count 1 00010000:00010000:1.0:1782487587.766803:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766816:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 109 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766824:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.766827:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.766831:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766854:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 109 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.766864:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 109 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.766876:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299248256:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.766915:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447d80 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.766948:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770ce00/2, rc 0, transno 8589940728 00000100:00100000:1.0:1782487587.766958:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299242880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.766998:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299248384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.767027:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.767049:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299248384 00000100:00100000:2.0:1782487587.767053:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299248384 00000100:00100000:2.0:1782487587.767079:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378 00000004:00080000:1.0:1782487587.767080:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547710380/2, rc 0, transno 8589940729 00000100:00100000:2.0:1782487587.767087:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3317:x1869066299248384:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.767091:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299242752:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.767099:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6124 count 1 00010000:00010000:2.0:1782487587.767111:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.767123:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 132 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767127:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782487587.767134:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ec:0x0].0x0 since=5s v=(0 0) 00000100:00100000:1.0:1782487587.767136:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299248512:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.767139:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.767144:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.767164:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 132 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.767173:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 132 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.767183:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299248640:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.767238:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299248512 00000100:00100000:1.0:1782487587.767243:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299248512 00000100:00100000:1.0:1782487587.767266:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379 00000100:00100000:1.0:1782487587.767272:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3315:x1869066299248512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.767281:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6127 count 1 00010000:00010000:1.0:1782487587.767290:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767300:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 132 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767304:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.767307:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.767310:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767324:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 132 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767331:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 132 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.767333:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.767341:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299248768:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.767359:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.767401:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299245440:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.767417:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767449:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299245568:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.767464:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767489:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299245824:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.767500:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767526:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299246208:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.767540:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.767560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.767565:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299246336:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.767578:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.767596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.767628:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412800 00000100:00100000:1.0:1782487587.767631:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412800 00010000:00010000:1.0:1782487587.767647:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 110 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.767654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.767680:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413056 00000100:00100000:0.0:1782487587.767680:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412672 00000100:00100000:1.0:1782487587.767684:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413056 00000100:00100000:0.0:1782487587.767686:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412672 00010000:00010000:1.0:1782487587.767696:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 111 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.767699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.767706:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767720:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412544 00000100:00100000:1.0:1782487587.767725:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412544 00000100:00100000:0.0:1782487587.767733:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6249 00010000:00010000:1.0:1782487587.767741:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.767743:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2363:x1869066294412800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.767756:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.767763:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 111 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767769:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6250 00000100:00100000:3.0:1782487587.767770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.767779:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 111 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.767785:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2361:x1869066294413056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.767798:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.767802:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfb3f4e/0x66475b4e8b854bc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475806 expref: 111 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767806:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 111 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.767824:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.767826:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 110 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.767828:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.767838:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.767848:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767849:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255d8911/0x66475b4e8b854a91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b2 expref: 110 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767871:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.767874:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.767877:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.767881:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.767883:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767899:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.767908:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2363:x1869066294412800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.767916:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6249 00000100:00100000:2.0:1782487587.767920:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.767921:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2361:x1869066294413056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.767929:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6250 00000100:00100000:0.0:1782487587.767934:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294412928 00000100:00100000:0.0:1782487587.767938:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294412928 00000100:00100000:2.0:1782487587.767941:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6251 00000100:00100000:2.0:1782487587.767949:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294412672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.767950:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6252 00010000:00010000:0.0:1782487587.767955:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 108 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.767960:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.767965:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2361:x1869066294412544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.767968:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.767974:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6253 00010000:00010000:2.0:1782487587.767985:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.767985:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.767985:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+108:2361:x1869066294412928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.767995:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.767996:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.768005:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007daed924/0x66475b4e8b854853 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a8 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.768005:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 108 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768010:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768021:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.768022:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 108 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768025:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.768030:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ee9ab3/0x66475b4e8b85246c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cfa expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768032:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.768039:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a56a3762/0x66475b4e8b854b16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c0 expref: 108 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768045:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.768047:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768052:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.768055:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.768059:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.768060:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.768069:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.768071:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768072:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.768088:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294412672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (492us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.768094:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.768096:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6251 00010000:00010000:1.0:1782487587.768102:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.768113:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.768122:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+132:2361:x1869066294412544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.768128:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6252 00010000:00010000:2.0:1782487587.768132:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.768138:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2361:x1869066294412928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 153us (369us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.768142:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.768145:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6253 00010000:00010000:1.0:1782487587.768147:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768151:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768157:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768170:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768172:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768199:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768215:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.768233:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.768464:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3314:x1869066299244416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9218us (9533us total) trans 8589940071 rc 0/0 00000100:00100000:1.0:1782487587.768466:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+59:3314:x1869066299244800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9229us (9622us total) trans 8589940732 rc 0/0 00000100:00100000:2.0:1782487587.768478:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16365 00000100:00100000:1.0:1782487587.768484:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16364 00010000:00010000:2.0:1782487587.768496:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.768502:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768510:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196d600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.768514:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768522:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768534:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768536:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768550:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd7b7ad/0x66475b4e8b85e66d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768554:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768565:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768569:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.768571:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768574:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768584:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025a800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.768587:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.768588:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768602:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768633:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768640:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bafb5e13/0x66475b4e8b85e674 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768655:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.768659:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768666:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025bc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.768670:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768677:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768685:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768692:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ba2edb/0x66475b4e8b85e67b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768710:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.768712:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.768714:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.768737:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770e680/2, rc 0, transno 8589940071 00000100:00100000:1.0:1782487587.768738:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3315:x1869066299245312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8824us (9029us total) trans 8589940072 rc 0/0 00000100:00100000:2.0:1782487587.768749:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.768753:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16366 00000004:00080000:2.0:1782487587.768763:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7b480/2, rc 0, transno 8589940732 00000100:00100000:2.0:1782487587.768772:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299244800:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.768778:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.768793:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768803:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768813:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.768820:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.768828:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1782487587.768830:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.768837:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299248896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.768866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.768894:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299248896 00000100:00100000:2.0:1782487587.768897:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299248896 00000100:00100000:2.0:1782487587.768922:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:2.0:1782487587.768930:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+62:3314:x1869066299248896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.768943:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6124 count 1 00010000:00010000:2.0:1782487587.768955:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768967:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 91 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.768974:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ec:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.768978:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.768980:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3314:x1869066299246080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7718us (7821us total) trans 8589940073 rc 0/0 00010000:00010000:2.0:1782487587.768983:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.768994:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16367 00010000:00010000:2.0:1782487587.769014:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 91 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769020:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.769027:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 91 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769029:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769048:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.769051:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299249152:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.769064:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769075:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.769085:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.769113:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558775880/2, rc 0, transno 8589940073 00000100:00100000:2.0:1782487587.769121:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299246080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.769155:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299249280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.769181:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.769212:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.769218:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299249024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.769249:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.769259:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3316:x1869066299244544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5091us (5248us total) trans 8589940074 rc 0/0 00000100:00100000:1.0:1782487587.769267:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16368 00000004:00080000:2.0:1782487587.769282:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770e300/2, rc 0, transno 8589940074 00000100:00100000:1.0:1782487587.769284:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299249280 00000100:00100000:1.0:1782487587.769289:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299249280 00000100:00100000:2.0:1782487587.769293:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299244544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.769309:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299249024 00000100:00100000:1.0:1782487587.769313:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299249024 00000100:00100000:2.0:1782487587.769326:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299249408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.769334:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381 00000100:00100000:1.0:1782487587.769341:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3317:x1869066299249280:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.769351:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1782487587.769352:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6119 count 1 00010000:00010000:1.0:1782487587.769364:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769374:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769379:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e7:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.769381:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.769384:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769399:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769408:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.769416:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299249536:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.769438:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.769455:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299249408 00000100:00100000:1.0:1782487587.769458:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299249408 00000100:00100000:1.0:1782487587.769481:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382 00000100:00100000:1.0:1782487587.769489:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3317:x1869066299249024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.769501:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6128 count 1 00010000:00010000:1.0:1782487587.769515:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769528:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 131 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769536:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f0:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.769538:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.769541:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769556:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 131 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769567:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 131 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.769576:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299249664:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.769593:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.769626:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1782487587.769632:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+63:3314:x1869066299249408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.769641:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6117 count 1 00010000:00010000:1.0:1782487587.769650:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769659:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 106 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769665:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 91 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769669:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e5:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.769672:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.769674:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769687:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 91 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769698:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 91 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.769706:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299249792:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.769751:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 106 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.769762:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 106 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.769771:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299249920:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.769788:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534470c0 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.769831:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79f80/2, rc 0, transno 8589940072 00000100:00100000:1.0:1782487587.769844:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299245312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.769890:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.769898:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299250048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.769921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.769948:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299250048 00000100:00100000:1.0:1782487587.769950:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299250048 00000100:00100000:1.0:1782487587.769970:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384 00000100:00100000:1.0:1782487587.769975:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+64:3314:x1869066299250048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.769984:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6121 count 1 00010000:00010000:1.0:1782487587.769993:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770002:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 106 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770008:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 91 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770013:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e9:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.770015:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.770018:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770031:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 91 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770038:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.770045:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299250176:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.770067:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 106 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770074:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 106 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.770085:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299250304:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.770097:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.770120:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.770124:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770130:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd06200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.770133:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770139:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770148:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770153:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d07f3f3/0x66475b4e8b85e682 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770168:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.770170:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770177:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.770181:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770200:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770213:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770221:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e689 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.770241:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.770244:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.770246:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.770253:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.771355:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.771425:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299247104:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.771448:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.771487:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299247360:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.771504:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.771515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.771539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.771553:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299246976:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.771561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.771570:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.771580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.771601:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299247488:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.771624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.771630:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.771649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.771666:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299248256:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.771674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.771689:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.771701:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413824 00000100:00100000:3.0:1782487587.771703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.771706:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413824 00000100:00100000:1.0:1782487587.771714:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413312 00000100:00100000:1.0:1782487587.771719:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413312 00000100:00100000:3.0:1782487587.771724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.771728:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 133 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.771741:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 133 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.771756:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413696 00000100:00100000:3.0:1782487587.771759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.771759:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413696 00000100:00100000:1.0:1782487587.771762:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414080 00000100:00100000:1.0:1782487587.771766:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414080 00010000:00010000:0.0:1782487587.771773:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 92 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.771788:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413184 00000100:00100000:0.0:1782487587.771792:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413184 00010000:00010000:1.0:1782487587.771793:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 134 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.771808:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 135 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.771813:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413440 00000100:00100000:1.0:1782487587.771817:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413440 00000100:00100000:0.0:1782487587.771830:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413568 00000100:00100000:0.0:1782487587.771834:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413568 00010000:00010000:1.0:1782487587.771838:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 136 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.771850:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299247232:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.771850:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 93 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.771854:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294413952 00000100:00100000:1.0:1782487587.771859:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294413952 00010000:00010000:2.0:1782487587.771866:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.771870:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414208 00000100:00100000:0.0:1782487587.771874:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414208 00000100:00100000:3.0:1782487587.771877:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414336 00000100:00100000:3.0:1782487587.771883:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414336 00010000:00010000:1.0:1782487587.771887:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 94 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.771891:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 107 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.771900:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6254 00010000:00010000:3.0:1782487587.771907:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 137 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.771914:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2362:x1869066294413824:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.771920:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6255 00010000:00010000:2.0:1782487587.771928:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.771929:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6256 00000100:00100000:1.0:1782487587.771933:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+137:2361:x1869066294413312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.771937:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.771941:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294413696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.771944:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.771950:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 137 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.771951:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6257 00010000:00010000:0.0:1782487587.771951:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.771952:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.771959:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 94 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.771979:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 137 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.771981:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3260a2/0x66475b4e8b852457 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cde expref: 137 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.771985:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 94 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.772003:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2361:x1869066294414080:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.772005:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772008:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022818100/0x66475b4e8b855263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f0 expref: 94 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772012:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772017:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.772017:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772018:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772021:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772024:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 136 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772025:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772027:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.772035:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772036:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772037:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772046:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 136 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772054:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772060:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772067:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.772071:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.772076:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.772080:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.772082:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772088:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.772090:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.772103:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2362:x1869066294413824:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.772105:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+136:2361:x1869066294413312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (565us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.772107:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.772114:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294413696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 174us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.772116:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6254 00000100:00100000:1.0:1782487587.772126:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6255 00000100:00100000:3.0:1782487587.772128:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+135:2361:x1869066294414080:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.772134:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6256 00000100:00100000:2.0:1782487587.772142:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6258 00000100:00100000:3.0:1782487587.772148:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6257 00000100:00100000:2.0:1782487587.772153:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+134:2360:x1869066294413184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.772154:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6259 00000100:00100000:0.0:1782487587.772162:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+133:2360:x1869066294413440:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.772163:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.772168:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6260 00010000:00010000:2.0:1782487587.772170:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772170:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.772176:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 133 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.772179:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6261 00000100:00100000:3.0:1782487587.772182:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2360:x1869066294413568:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.772186:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.772203:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294413952:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.772208:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.772216:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 92 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772218:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f578fff3/0x66475b4e8b852449 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cd7 expref: 133 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772219:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.772221:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 133 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772228:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 92 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772239:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 92 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772245:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772250:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165468c5/0x66475b4e8b8519f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474abc expref: 132 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772251:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.772251:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 92 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772258:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772259:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057dc781e/0x66475b4e8b854f30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475909 expref: 92 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772270:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.772276:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772278:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.772279:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772280:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772284:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.772284:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772289:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772296:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772303:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.772306:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772307:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.772308:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772316:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.772328:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+131:2360:x1869066294413184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (723us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.772333:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.772341:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6258 00010000:00010000:0.0:1782487587.772342:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.772350:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.772358:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2361:x1869066294413952:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 169us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.772361:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6262 00000100:00100000:0.0:1782487587.772367:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+130:2360:x1869066294413440:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 204us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.772375:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2360:x1869066294413568:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 193us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.772375:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2360:x1869066294414208:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.772375:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6261 00000100:00100000:0.0:1782487587.772383:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6259 00010000:00010000:2.0:1782487587.772389:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.772391:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6260 00010000:00010000:2.0:1782487587.772397:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 107 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.772401:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6263 00000100:00100000:1.0:1782487587.772413:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+129:2360:x1869066294414336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.772416:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 107 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772425:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.772432:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 129 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772435:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da665436/0x66475b4e8b855025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47594f expref: 107 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772438:0:213384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098e93d41/0x66475b4e8b852473 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474cec expref: 129 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.772463:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299248000:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.772464:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.772466:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 128 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772472:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772479:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772481:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772488:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.772495:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772495:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.772500:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772502:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772505:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772525:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772527:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772530:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.772537:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772543:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.772549:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2360:x1869066294414208:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (826us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.772556:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.772556:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6262 00000100:00100000:1.0:1782487587.772563:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+128:2360:x1869066294414336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 151us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.772571:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6263 00010000:00010000:1.0:1782487587.772597:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.772600:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772602:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772628:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772647:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772648:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d34800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.772655:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772659:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772670:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772678:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.772693:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772700:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006013bc9f/0x66475b4e8b85e6c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772721:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.772725:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772732:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d34000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.772736:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772744:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772756:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772763:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19e0f8a/0x66475b4e8b85e6a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772783:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.772786:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.772790:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.772835:0:213211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b8524ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d08 expref: 127 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.772839:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+60:3314:x1869066299247744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6486us (6569us total) trans 8589940733 rc 0/0 00000100:00100000:3.0:1782487587.772848:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16376 00000100:00100000:1.0:1782487587.772848:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299248768:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.772864:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772873:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772880:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.772887:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3315:x1869066299246592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7880us (8288us total) trans 8589940075 rc 0/0 00010000:00010000:3.0:1782487587.772888:0:213222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d56f1cf/0x66475b4e8b8525e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d24 expref: 126 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.772890:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.772903:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16372 00010000:00010000:1.0:1782487587.772906:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.772909:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299246464:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.772923:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.772931:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772931:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772951:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772954:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772967:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772968:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.772986:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.772989:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773004:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773005:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.773023:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1782487587.773162:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+60:3317:x1869066299246848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7907us (8079us total) trans 8589940734 rc 0/0 00000100:00100000:2.0:1782487587.773172:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373 00000004:00080000:2.0:1782487587.773217:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558776300/2, rc 0, transno 8589940734 00000100:00100000:2.0:1782487587.773228:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299246848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.773279:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.773290:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299250432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.773314:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3315:x1869066299248512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6041us (6154us total) trans 8589940735 rc 0/0 00000100:00100000:2.0:1782487587.773322:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.773327:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379 00000100:00100000:1.0:1782487587.773348:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299250432 00000100:00100000:1.0:1782487587.773352:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299250432 00000004:00080000:2.0:1782487587.773365:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a9180/2, rc 0, transno 8589940735 00000100:00100000:2.0:1782487587.773376:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299248512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.773384:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000004:00080000:2.0:1782487587.773390:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558774700/2, rc 0, transno 8589940075 00000100:00100000:1.0:1782487587.773395:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3317:x1869066299250432:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.773404:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299246592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.773412:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3316:x1869066299245696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9199us (9326us total) trans 8589940736 rc 0/0 00002000:00080000:1.0:1782487587.773412:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6132 count 1 00000100:00100000:3.0:1782487587.773420:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16369 00010000:00010000:1.0:1782487587.773428:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773441:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 119 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773450:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=5s v=(0 0) 00000100:00100000:2.0:1782487587.773452:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299250560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.773454:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.773458:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.773461:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773463:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773471:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edffa00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.773475:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773478:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.773485:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 119 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773492:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773497:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 119 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773506:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773507:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.773510:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299250816:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.773518:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff7c8ab7/0x66475b4e8b85e6d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773519:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299250688:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.773540:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.773544:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773553:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.773554:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447e40 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.773558:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb546d37200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.773562:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773576:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.773577:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299250560 00010000:00010000:2.0:1782487587.773579:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.773581:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299250560 00010000:00010000:2.0:1782487587.773587:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773591:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773602:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.773626:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000352bf9ea/0x66475b4e8b85e6ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773628:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773649:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773656:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.773657:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299250688 00010000:00010000:3.0:1782487587.773659:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.773661:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299250688 00010000:00010000:2.0:1782487587.773662:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.773663:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.773672:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f658e5/0x66475b4e8b85e690 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.773687:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00010000:00010000:2.0:1782487587.773689:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.773693:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.773696:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.773700:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+65:3317:x1869066299250560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.773713:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6126 count 1 00000100:00100000:2.0:1782487587.773719:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299248640:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.773726:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773736:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773741:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 105 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773752:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ee:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.773756:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.773760:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773761:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:2.0:1782487587.773774:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3315:x1869066299250688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.773785:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 105 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.773788:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6133 count 1 00000100:00100000:3.0:1782487587.773799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.773799:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 105 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773802:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.773819:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299250944:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.773821:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414592 00010000:00010000:2.0:1782487587.773823:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 119 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.773828:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414592 00010000:00010000:2.0:1782487587.773832:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.773835:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.773840:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.773848:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 90 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.773851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.773851:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.773861:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 119 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.773869:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.773873:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 119 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.773876:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414464 00000100:00100000:0.0:1782487587.773879:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414464 00000100:00100000:2.0:1782487587.773885:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299251072:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.773894:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.773898:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434aa680/2, rc 0, transno 8589940733 00000100:00100000:2.0:1782487587.773908:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.773915:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299247744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.773920:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6264 00000100:00100000:0.0:1782487587.773930:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2360:x1869066294414592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.773934:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299249152:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.773938:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.773942:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 90 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.773947:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.773955:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 90 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.773960:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.773971:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299251200:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.773971:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317bd755/0x66475b4e8b855710 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b71 expref: 90 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.773984:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6265 00010000:00010000:0.0:1782487587.773987:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.773991:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.773994:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+126:2361:x1869066294414464:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.773996:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774003:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.774004:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774008:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.774012:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774023:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.774026:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.774037:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000636cb3f4/0x66475b4e8b852481 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d01 expref: 126 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774040:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299251200 00000100:00100000:1.0:1782487587.774046:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299251200 00000100:00100000:0.0:1782487587.774046:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2360:x1869066294414592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 118us (248us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.774050:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.774053:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.774058:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.774059:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6264 00010000:00010000:2.0:1782487587.774066:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774075:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388 00010000:00010000:2.0:1782487587.774081:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.774086:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3314:x1869066299251200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.774100:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6134 count 1 00000100:00100000:2.0:1782487587.774102:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2361:x1869066294414464:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.774111:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6265 00010000:00010000:1.0:1782487587.774114:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774131:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774131:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 119 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774153:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774153:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.774159:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.774170:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774170:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774203:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774218:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.774220:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 119 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774231:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 119 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774244:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299251328:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.774273:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.774292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.774308:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299249664:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.774326:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774361:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299249792:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.774368:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3317:x1869066299248384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7282us (7341us total) trans 8589940737 rc 0/0 00000100:00100000:2.0:1782487587.774376:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378 00000100:00100000:1.0:1782487587.774378:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299249920:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.774397:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414848 00010000:00010000:1.0:1782487587.774401:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.774402:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414848 00000100:00100000:3.0:1782487587.774407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.774421:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 125 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774423:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.774432:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774441:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.774442:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414720 00000100:00100000:2.0:1782487587.774446:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414720 00010000:00010000:1.0:1782487587.774446:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774458:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774460:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774484:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.774493:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6266 00010000:00010000:1.0:1782487587.774495:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e6cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.774504:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6267 00000100:00100000:2.0:1782487587.774504:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2360:x1869066294414848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.774518:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2361:x1869066294414720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.774518:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.774527:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 125 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774528:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.774532:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.774532:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.774537:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.774540:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774542:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 125 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774561:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299250176:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.774565:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 106 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774571:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df70884a/0x66475b4e8b852537 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474d1d expref: 125 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774583:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774598:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.774599:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774601:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.774625:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.774628:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774629:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774633:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.774645:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774645:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774645:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774671:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774671:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.774678:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.774692:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.774706:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2361:x1869066294414720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 191us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.774718:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6267 00000100:00100000:2.0:1782487587.774718:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2360:x1869066294414848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 215us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.774730:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6266 00010000:00010000:3.0:1782487587.774744:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.774750:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774757:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774758:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.774765:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774770:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774780:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774783:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774800:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774803:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.774816:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.774825:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044145043/0x66475b4e8b85e697 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.774837:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3317:x1869066299244672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10138us (10446us total) trans 8589940738 rc 0/0 00010000:00010000:3.0:1782487587.774844:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.774845:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370 00010000:00010000:3.0:1782487587.774848:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774855:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.774859:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774867:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774872:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774880:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774881:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774890:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85e6dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774896:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774903:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774910:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.774913:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.774916:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.774917:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782487587.774928:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.774932:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774939:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774950:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.774957:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68fb442/0x66475b4e8b85e6eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.774959:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+66:3314:x1869066299248896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6030us (6092us total) trans 8589940076 rc 0/0 00000100:00100000:2.0:1782487587.774974:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00010000:00010000:3.0:1782487587.774984:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.774988:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.774991:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.775014:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a9c00/2, rc 0, transno 8589940737 00000100:00100000:2.0:1782487587.775024:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299248384:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.775035:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7b800/2, rc 0, transno 8589940738 00000100:00100000:2.0:1782487587.775040:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299244672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.775097:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299251584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.775098:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3317:x1869066299249024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5607us (5845us total) trans 8589940739 rc 0/0 00000100:00100000:1.0:1782487587.775110:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00000100:00100000:2.0:1782487587.775129:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.775148:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299250304:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.775165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:2.0:1782487587.775165:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549181500/2, rc 0, transno 8589940739 00010000:00010000:1.0:1782487587.775170:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.775180:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299249024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.775202:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.775208:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299251456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.775210:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299251584 00000100:00100000:1.0:1782487587.775215:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299251584 00000100:00100000:2.0:1782487587.775234:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.775244:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299251456 00000100:00100000:1.0:1782487587.775249:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299251456 00000100:00100000:3.0:1782487587.775270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.775275:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389 00000100:00100000:2.0:1782487587.775284:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415104 00000100:00100000:1.0:1782487587.775285:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+64:3317:x1869066299251584:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.775288:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415104 00000100:00100000:3.0:1782487587.775301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00002000:00080000:1.0:1782487587.775301:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6136 count 1 00010000:00010000:2.0:1782487587.775308:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 106 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775316:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.775330:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294414976 00010000:00010000:1.0:1782487587.775330:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 119 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.775333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.775335:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294414976 00010000:00010000:1.0:1782487587.775343:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.775346:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.775349:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 89 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775352:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.775359:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415232 00000100:00100000:3.0:1782487587.775364:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415232 00000100:00100000:2.0:1782487587.775375:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415360 00000100:00100000:2.0:1782487587.775379:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415360 00010000:00010000:3.0:1782487587.775384:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 90 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775384:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 119 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775396:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 107 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775400:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 119 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.775417:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299251840:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.775464:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.775465:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6268 00000100:00100000:2.0:1782487587.775475:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6269 00000100:00100000:3.0:1782487587.775479:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2360:x1869066294415104:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.775485:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390 00010000:00010000:3.0:1782487587.775490:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.775490:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2360:x1869066294414976:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.775497:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+64:3317:x1869066299251456:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.775498:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 107 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775500:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.775508:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 90 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.775511:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6135 count 1 00010000:00010000:3.0:1782487587.775515:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 107 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775526:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775534:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 90 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775539:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775552:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f7:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.775555:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.775557:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9621fd1/0x66475b4e8b8550b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475980 expref: 107 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775561:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775564:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1dc3cc0/0x66475b4e8b855a20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e5:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c35 expref: 90 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775570:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.775578:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.775584:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775588:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775593:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.775598:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775601:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.775627:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.775630:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299251968:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.775643:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2360:x1869066294414976:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.775650:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2360:x1869066294415104:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.775654:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6269 00000100:00100000:1.0:1782487587.775655:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.775662:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6268 00010000:00010000:1.0:1782487587.775672:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.775678:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6270 00010000:00010000:1.0:1782487587.775686:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.775692:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+88:2360:x1869066294415232:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.775701:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6271 00010000:00010000:1.0:1782487587.775702:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775706:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.775713:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.775715:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066294415360:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.775715:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 88 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775734:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.775735:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.775737:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 88 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775742:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 105 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775757:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863ddfae/0x66475b4e8b855b9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c97 expref: 88 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775759:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 105 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775784:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.775786:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea2e602/0x66475b4e8b8556a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b39 expref: 105 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775789:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.775798:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.775807:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775816:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.775826:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.775839:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+104:2360:x1869066294415360:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.775847:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6271 00000100:00100000:2.0:1782487587.775852:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2360:x1869066294415232:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.775859:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6270 00010000:00010000:3.0:1782487587.775869:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.775875:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.775883:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.775887:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.775893:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299251712:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.775899:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.775904:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+66:3314:x1869066299249408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6272us (6552us total) trans 8589940077 rc 0/0 00010000:00010000:3.0:1782487587.775914:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.775915:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000100:00100000:2.0:1782487587.775924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.775925:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f344fc5/0x66475b4e8b85e6f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.775934:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299251712 00000100:00100000:1.0:1782487587.775937:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299251712 00010000:00010000:3.0:1782487587.775946:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.775949:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.775952:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.775955:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549181180/2, rc 0, transno 8589940077 00000100:00100000:1.0:1782487587.775966:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:2.0:1782487587.775968:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299249408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.775976:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+65:3314:x1869066299251712:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.775984:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549180a80/2, rc 0, transno 8589940076 00000100:00100000:2.0:1782487587.775990:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299248896:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.775990:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6138 count 1 00010000:00010000:1.0:1782487587.776005:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776018:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 123 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776027:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fa:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.776030:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.776034:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776045:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.776052:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299252224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.776058:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 123 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776069:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 123 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.776082:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299252352:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.776113:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299252224 00000100:00100000:2.0:1782487587.776117:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299252224 00000100:00100000:1.0:1782487587.776126:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447780 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.776141:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392 00010000:00010000:1.0:1782487587.776148:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776150:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+66:3317:x1869066299252224:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.776163:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.776165:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6127 count 1 00010000:00010000:1.0:1782487587.776176:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776180:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776207:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 86 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776209:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776226:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ef:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.776230:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.776234:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776238:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.776256:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 86 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776266:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 86 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776267:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.776276:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776281:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299252480:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.776291:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578deb200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.776295:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776303:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776316:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776316:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.776327:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006556fe8b/0x66475b4e8b85e6f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776337:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.776348:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299252096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.776349:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.776353:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.776358:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.776378:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.776403:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299252096 00000100:00100000:2.0:1782487587.776406:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299252096 00000100:00100000:1.0:1782487587.776421:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+68:3314:x1869066299250048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6443us (6497us total) trans 8589940078 rc 0/0 00000100:00100000:1.0:1782487587.776429:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384 00000100:00100000:2.0:1782487587.776435:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393 00000100:00100000:2.0:1782487587.776444:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3314:x1869066299252096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.776454:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6125 count 1 00010000:00010000:1.0:1782487587.776456:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.776464:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776476:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 103 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776483:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ed:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.776486:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1782487587.776490:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434ab800/2, rc 0, transno 8589940078 00010000:00010000:2.0:1782487587.776491:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.776504:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299250048:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.776513:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 103 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776524:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 103 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776535:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299252608:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.776543:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.776565:0:190931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ee9a16/0x66475b4e8b855048 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475972 expref: 103 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776569:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be180 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.776582:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299249536:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.776589:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299252736:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.776599:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776634:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.776645:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776653:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776662:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776664:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299252736 00000100:00100000:2.0:1782487587.776668:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299252736 00010000:00010000:1.0:1782487587.776675:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776690:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394 00010000:00010000:1.0:1782487587.776694:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.776699:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+68:3317:x1869066299252736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.776711:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6128 count 1 00010000:00010000:3.0:1782487587.776717:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.776724:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776724:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776743:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4a196de00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.776748:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776749:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776769:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776769:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f0:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.776775:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.776782:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776790:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776799:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6daf46f/0x66475b4e8b85e6e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776802:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.776821:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.776827:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.776830:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.776832:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299252864:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.776834:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.776863:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299249280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7522us (7681us total) trans 8589940079 rc 0/0 00000100:00100000:1.0:1782487587.776871:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381 00000100:00100000:2.0:1782487587.776881:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.776910:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549180700/2, rc 0, transno 8589940079 00000100:00100000:2.0:1782487587.776920:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299249280:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.776927:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776937:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.776945:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776960:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782487587.776960:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.776969:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299252992:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.776979:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.776996:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.777025:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.777030:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777037:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.777041:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777050:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777062:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777069:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b07197/0x66475b4e8b85e6b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777090:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.777093:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.777095:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.777107:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777115:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.777123:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299246720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11705us (11987us total) trans 8589940080 rc 0/0 00000100:00100000:1.0:1782487587.777139:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16374 00010000:00010000:2.0:1782487587.777140:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777150:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.777158:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299252992 00000100:00100000:1.0:1782487587.777162:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299252992 00010000:00010000:2.0:1782487587.777164:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.777185:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16395 00000100:00100000:1.0:1782487587.777207:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3315:x1869066299252992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.777219:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6129 count 1 00010000:00010000:1.0:1782487587.777231:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777242:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 102 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777249:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f1:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.777253:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.777256:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777276:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 102 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777291:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 102 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.777302:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299253120:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.777332:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+66:3317:x1869066299245952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12468us (12895us total) trans 8589940740 rc 0/0 00000100:00100000:2.0:1782487587.777340:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16371 00000100:00100000:1.0:1782487587.777341:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.777357:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.777362:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777370:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.777374:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777383:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777398:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777405:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e69e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777427:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.777430:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.777435:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.777458:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558776680/2, rc 0, transno 8589940080 00010000:00010000:1.0:1782487587.777463:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.777469:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299246720:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.777483:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558775180/2, rc 0, transno 8589940740 00000100:00100000:2.0:1782487587.777493:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299245952:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.777499:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e89fcf8/0x66475b4e8b855278 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4759f7 expref: 86 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.777512:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299247872:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.777525:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777534:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777541:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777550:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777554:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782487587.777558:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777565:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299253376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.777579:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.777584:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.777589:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777589:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.777600:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edff200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.777631:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.777645:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.777659:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.777666:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070db8291/0x66475b4e8b85e6ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777671:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299253248:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.777689:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.777694:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.777697:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.777702:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.777743:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777751:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777765:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777772:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.777785:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.777811:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+70:3315:x1869066299247616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11474us (11713us total) trans 8589940081 rc 0/0 00000100:00100000:1.0:1782487587.777819:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16375 00000100:00100000:1.0:1782487587.777838:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299253376 00000100:00100000:1.0:1782487587.777842:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299253376 00000100:00100000:1.0:1782487587.777864:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299253248 00000100:00100000:1.0:1782487587.777868:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299253248 00000100:00100000:1.0:1782487587.777892:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16396 00000100:00100000:1.0:1782487587.777901:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+71:3317:x1869066299253376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.777912:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6130 count 1 00010000:00010000:1.0:1782487587.777924:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777935:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 102 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.777942:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f2:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.777945:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.777950:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777951:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3317:x1869066299248128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11174us (11253us total) trans 8589940082 rc 0/0 00000100:00100000:2.0:1782487587.777967:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377 00010000:00010000:1.0:1782487587.777978:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 102 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777987:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16397 00010000:00010000:1.0:1782487587.777989:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 102 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.777999:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3315:x1869066299253248:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.778003:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299253504:192.168.202.21@tcp:104: 00002000:00080000:2.0:1782487587.778014:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6137 count 1 00010000:00010000:2.0:1782487587.778028:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778039:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 123 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778047:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f9:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.778050:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.778053:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.778054:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534470c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.778077:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 123 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778088:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.778098:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299253632:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.778100:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770ed80/2, rc 0, transno 8589940081 00000100:00100000:1.0:1782487587.778111:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299247616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.778137:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.778171:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299253760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.778210:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487587.778242:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a8e00/2, rc 0, transno 8589940082 00000100:00100000:2.0:1782487587.778250:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299248128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.778303:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299253760 00000100:00100000:2.0:1782487587.778306:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299253760 00000100:00100000:2.0:1782487587.778332:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16398 00000100:00100000:2.0:1782487587.778339:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3317:x1869066299253760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.778352:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6134 count 1 00010000:00010000:2.0:1782487587.778364:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778375:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 85 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778382:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f6:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.778385:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.778389:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778411:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 85 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778421:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 85 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.778431:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299254016:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.778467:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be480 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.778491:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299253888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.778520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.778542:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299253888 00000100:00100000:1.0:1782487587.778547:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299253888 00010000:00010000:2.0:1782487587.778561:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.778566:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778574:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57edfe400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.778578:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.778579:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16399 00010000:00010000:2.0:1782487587.778590:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.778591:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3314:x1869066299253888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.778625:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6132 count 1 00010000:00010000:2.0:1782487587.778630:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778638:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778653:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db394d07/0x66475b4e8b85e6c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778659:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 102 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778669:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f4:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.778672:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.778676:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.778676:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.778680:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.778685:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.778698:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 102 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778709:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 102 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.778715:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558775c00/2, rc 0, transno 8589940736 00000100:00100000:1.0:1782487587.778720:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299254144:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.778728:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299245696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.778770:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.778771:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.778778:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299254272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.778806:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.778866:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299250816:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.778884:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.778904:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299254272 00000100:00100000:1.0:1782487587.778907:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299254272 00000100:00100000:1.0:1782487587.778939:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16400 00000100:00100000:1.0:1782487587.778947:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3314:x1869066299254272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.778959:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6142 count 1 00010000:00010000:1.0:1782487587.778971:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778982:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 119 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.778989:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fe:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.778992:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.778996:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779013:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 119 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779022:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 119 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779034:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299254400:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.779060:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.779231:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299251072:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.779253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.779257:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.779306:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415488 00000100:00100000:3.0:1782487587.779310:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415488 00000100:00100000:1.0:1782487587.779311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.779312:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415744 00000100:00100000:2.0:1782487587.779317:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415744 00010000:00010000:3.0:1782487587.779332:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 121 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.779340:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 121 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.779354:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415616 00000100:00100000:3.0:1782487587.779359:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415616 00000100:00100000:2.0:1782487587.779368:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294415872 00000100:00100000:2.0:1782487587.779372:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294415872 00010000:00010000:3.0:1782487587.779377:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 103 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779392:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 122 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.779405:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299251968:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.779410:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299250944:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.779425:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6272 00010000:00010000:0.0:1782487587.779425:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779430:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.779438:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2361:x1869066294415488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.779453:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6273 00010000:00010000:2.0:1782487587.779453:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.779463:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 122 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.779469:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+122:2361:x1869066294415744:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.779471:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299252352:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.779484:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.779489:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 122 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779490:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779492:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 122 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779508:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 122 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779518:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299251328:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.779526:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026dd1a70/0x66475b4e8b852d56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474de8 expref: 122 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779533:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779534:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfe84552/0x66475b4e8b852cf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a474dda expref: 122 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779537:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.779545:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.779553:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779558:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.779567:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.779567:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6274 00010000:00010000:3.0:1782487587.779569:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779576:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779578:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2361:x1869066294415872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.779589:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.779592:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.779593:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779599:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 120 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779641:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.779646:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 120 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.779651:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2361:x1869066294415744:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 186us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.779659:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6273 00010000:00010000:1.0:1782487587.779666:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fe8fccc/0x66475b4e8b853257 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475011 expref: 120 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.779667:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+120:2361:x1869066294415488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 229us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.779678:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6275 00000100:00100000:2.0:1782487587.779686:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6272 00010000:00010000:1.0:1782487587.779686:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.779691:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2361:x1869066294415616:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.779693:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.779698:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779700:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.779705:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 103 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779707:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779723:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 103 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779726:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.779738:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299252480:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.779740:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c87dbd1/0x66475b4e8b8556d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b6a expref: 103 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.779749:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2361:x1869066294415872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (412us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.779755:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.779757:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6274 00010000:00010000:2.0:1782487587.779758:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779759:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.779768:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779778:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779783:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779786:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.779799:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.779799:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779803:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.779813:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779816:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779823:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.779824:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2361:x1869066294415616:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (511us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.779840:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779841:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779845:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.779867:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.779874:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.779877:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.779884:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.779894:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1782487587.780115:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6275 00000100:00100000:2.0:1782487587.780121:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3315:x1869066299250688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6348us (6570us total) trans 8589940741 rc 0/0 00000100:00100000:2.0:1782487587.780129:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00010000:00010000:3.0:1782487587.780135:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782487587.780141:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.780150:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb547180000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.780154:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780155:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3317:x1869066299250432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6763us (6832us total) trans 8589940742 rc 0/0 00000100:00100000:1.0:1782487587.780164:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385 00000100:00100000:0.0:1782487587.780165:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+73:3317:x1869066299250560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6466us (6684us total) trans 8589940083 rc 0/0 00000004:00080000:2.0:1782487587.780167:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549181f80/2, rc 0, transno 8589940741 00010000:00010000:3.0:1782487587.780173:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780182:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299250688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.780182:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00010000:00010000:1.0:1782487587.780186:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.780205:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780213:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.780217:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780224:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780239:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780244:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299254528:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.780255:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e70e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.780272:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780272:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.780276:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.780286:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b5c5c9/0x66475b4e8b85e700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780296:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb578dea200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.780300:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.780305:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.780308:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.780309:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.780311:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.780321:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780329:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ee9ab3/0x66475b4e8b85e707 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780330:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299252608:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.780358:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.780361:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780361:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.780365:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.780374:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.780385:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780394:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780397:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299252864:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.780410:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.780412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.780416:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780441:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.780451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.780453:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299254528 00000100:00100000:2.0:1782487587.780457:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299254528 00010000:00010000:1.0:1782487587.780458:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.780494:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401 00000100:00100000:0.0:1782487587.780494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.780506:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+68:3316:x1869066299254528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.780521:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6143 count 1 00010000:00010000:2.0:1782487587.780535:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.780549:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 116 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.780558:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ff:0x0].0x0 since=5s v=(0 0) 00000100:00100000:0.0:1782487587.780559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.780564:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.780569:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.780589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.780593:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 116 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780631:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3314:x1869066299251200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6545us (6623us total) trans 8589940743 rc 0/0 00010000:00010000:2.0:1782487587.780637:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 116 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780643:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388 00000100:00100000:2.0:1782487587.780656:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299254656:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.780664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.780678:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299251840:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.780691:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780719:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.780726:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549183b80/2, rc 0, transno 8589940083 00000100:00100000:1.0:1782487587.780738:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299250560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.780742:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416128 00000100:00100000:2.0:1782487587.780747:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416128 00000004:00080000:1.0:1782487587.780752:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549180000/2, rc 0, transno 8589940742 00000100:00100000:1.0:1782487587.780762:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299250432:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.780768:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 124 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.780786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.780797:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416384 00000100:00100000:2.0:1782487587.780802:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416384 00000100:00100000:0.0:1782487587.780820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.780821:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 102 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780829:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299254784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.780840:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416640 00000100:00100000:2.0:1782487587.780844:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416640 00010000:00010000:2.0:1782487587.780859:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 103 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780869:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.780876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.780877:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416000 00000100:00100000:2.0:1782487587.780881:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416000 00010000:00010000:2.0:1782487587.780896:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 117 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780909:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299254784 00000100:00100000:1.0:1782487587.780914:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299254784 00000100:00100000:2.0:1782487587.780919:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416256 00000100:00100000:2.0:1782487587.780923:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416256 00010000:00010000:2.0:1782487587.780938:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 86 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.780945:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16402 00000100:00100000:1.0:1782487587.780957:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3317:x1869066299254784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.780960:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416512 00000100:00100000:2.0:1782487587.780964:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416512 00002000:00080000:1.0:1782487587.780971:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6131 count 1 00010000:00010000:2.0:1782487587.780978:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 104 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.780986:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.780990:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416768 00000100:00100000:2.0:1782487587.780994:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416768 00010000:00010000:1.0:1782487587.781005:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 104 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781009:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 118 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781024:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f3:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.781029:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781034:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781036:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294416896 00000100:00100000:2.0:1782487587.781041:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294416896 00010000:00010000:2.0:1782487587.781060:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 105 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781062:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 105 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.781076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.781088:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417024 00010000:00010000:1.0:1782487587.781088:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781093:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417024 00000100:00100000:1.0:1782487587.781104:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299255040:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.781110:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 125 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781127:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417152 00000100:00100000:2.0:1782487587.781130:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417152 00000100:00100000:1.0:1782487587.781137:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.781146:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 87 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781164:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6276 00000100:00100000:1.0:1782487587.781170:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299254144:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.781176:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+125:2360:x1869066294416128:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.781185:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.781202:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781208:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 125 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.781224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.781229:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 125 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781235:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299253120:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.781250:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002522079f/0x66475b4e8b853591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475114 expref: 125 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781252:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781270:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781278:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781284:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781293:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781298:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299254400:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.781311:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781318:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.781332:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417408 00010000:00010000:0.0:1782487587.781334:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781337:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417408 00000100:00100000:2.0:1782487587.781346:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+124:2360:x1869066294416128:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (935us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.781349:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781355:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 119 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781359:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6276 00010000:00010000:0.0:1782487587.781369:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.781379:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781384:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6277 00000100:00100000:1.0:1782487587.781395:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066294416384:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.781404:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.781406:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.781408:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6278 00010000:00010000:3.0:1782487587.781411:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.781413:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 105 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781417:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781423:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066294416640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.781428:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 105 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781430:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4d025b600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.781435:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781437:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.781448:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781448:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 105 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781449:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000116477f9/0x66475b4e8b8556d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b5c expref: 105 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781472:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781473:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781477:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 104 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781478:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781487:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781503:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2625cda/0x66475b4e8b85e715 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781503:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781511:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1cef7ee/0x66475b4e8b856357 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475edc expref: 104 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781525:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781526:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.781530:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781536:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781544:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781554:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2360:x1869066294416384:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 157us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.781563:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6277 00010000:00010000:2.0:1782487587.781565:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.781569:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+69:3314:x1869066299251712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5592us (5643us total) trans 8589940744 rc 0/0 00010000:00010000:3.0:1782487587.781574:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.781579:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.781581:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000100:00100000:1.0:1782487587.781586:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6279 00000100:00100000:2.0:1782487587.781591:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2360:x1869066294416640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (1099us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.781593:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.781599:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781599:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+119:2360:x1869066294416000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.781628:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781631:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.781637:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781641:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781648:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603cb6c2/0x66475b4e8b85e72a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781648:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781649:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6278 00000100:00100000:0.0:1782487587.781666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.781669:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b30d49/0x66475b4e8b85327a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475018 expref: 119 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.781672:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.781676:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.781677:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6280 00010000:00010000:3.0:1782487587.781678:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.781686:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.781690:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2360:x1869066294416256:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.781692:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781701:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781703:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.781713:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 87 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781724:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781731:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 87 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781748:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.781749:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd342138/0x66475b4e8b856040 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475dd2 expref: 87 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781761:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781765:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781770:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781777:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+118:2360:x1869066294416000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 179us (1218us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.781781:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.781787:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6279 00010000:00010000:2.0:1782487587.781808:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.781808:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417280 00000100:00100000:1.0:1782487587.781813:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417280 00010000:00010000:1.0:1782487587.781828:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 102 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.781839:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2360:x1869066294416256:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 149us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.781848:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6280 00000100:00100000:1.0:1782487587.781855:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6281 00000100:00100000:1.0:1782487587.781865:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2360:x1869066294416512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.781871:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6282 00010000:00010000:1.0:1782487587.781877:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.781882:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+117:2360:x1869066294416768:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.781885:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781894:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.781896:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781902:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 117 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781919:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e76f103/0x66475b4e8b856476 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f45 expref: 102 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781920:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 117 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781946:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ec0695/0x66475b4e8b853425 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47508f expref: 117 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781951:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781960:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781965:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.781966:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781970:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.781979:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.781983:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.781992:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782007:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.782016:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.782040:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2360:x1869066294416512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 175us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.782045:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+116:2360:x1869066294416768:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.782054:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6281 00000100:00100000:2.0:1782487587.782065:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6282 00000100:00100000:1.0:1782487587.782078:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6283 00000100:00100000:2.0:1782487587.782088:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6284 00000100:00100000:1.0:1782487587.782089:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2361:x1869066294416896:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.782100:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2361:x1869066294417024:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.782100:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.782110:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 100 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782112:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.782122:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782128:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 100 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782141:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 123 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782144:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782152:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782158:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782161:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.782169:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782171:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782176:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782186:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.782222:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2361:x1869066294416896:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.782229:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6283 00010000:00010000:2.0:1782487587.782243:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782260:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.782268:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6285 00000100:00100000:1.0:1782487587.782275:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2360:x1869066294417152:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.782282:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.782287:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2361:x1869066294417024:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 190us (1414us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.782289:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 85 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.782301:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6284 00010000:00010000:1.0:1782487587.782309:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 85 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.782319:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6286 00010000:00010000:1.0:1782487587.782324:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.782329:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2360:x1869066294417408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.782331:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782339:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782340:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.782348:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 115 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782354:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782366:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 115 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.782384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.782387:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.782404:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049789c10/0x66475b4e8b853b10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752d4 expref: 115 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782415:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.782420:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2360:x1869066294417152:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (1347us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.782421:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.782429:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.782435:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6285 00010000:00010000:2.0:1782487587.782444:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.782450:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417536 00000100:00100000:1.0:1782487587.782454:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417536 00010000:00010000:2.0:1782487587.782465:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.782465:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 115 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.782476:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.782487:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6287 00000100:00100000:2.0:1782487587.782493:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+115:2360:x1869066294417408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 164us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.782502:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2361:x1869066294417280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.782504:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.782510:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6286 00010000:00010000:1.0:1782487587.782515:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.782522:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782524:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 99 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.782531:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6288 00010000:00010000:0.0:1782487587.782543:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.782545:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2361:x1869066294417536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.782550:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 99 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782558:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.782568:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 114 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782578:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337cb9a7/0x66475b4e8b856786 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47603a expref: 99 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.782579:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.782585:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 114 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782603:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782623:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782627:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782633:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.782636:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782638:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.782646:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782656:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782663:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.782671:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.782689:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294417280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 190us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.782698:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2361:x1869066294417536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 155us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.782700:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6287 00000100:00100000:2.0:1782487587.782711:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6288 00010000:00010000:1.0:1782487587.782731:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782742:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782750:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782751:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782772:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782773:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.782794:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.782799:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3314:x1869066299254272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3850us (3989us total) trans 8589940745 rc 0/0 00010000:00010000:2.0:1782487587.782802:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.782813:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16400 00010000:00010000:2.0:1782487587.782816:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.782835:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487587.782867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.782973:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299251456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7478us (7738us total) trans 8589940746 rc 0/0 00000100:00100000:1.0:1782487587.782980:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390 00000100:00100000:1.0:1782487587.783015:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299255040:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.783037:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.783042:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299251584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7757us (7911us total) trans 8589940747 rc 0/0 00000100:00100000:2.0:1782487587.783057:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389 00010000:00010000:1.0:1782487587.783066:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783075:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783080:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.783083:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783086:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783098:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783103:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb46fd07000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.783110:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783112:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782487587.783123:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783136:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783145:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9e74d7f/0x66475b4e8b85e769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783164:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.783168:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783176:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454b0da00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.783181:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783209:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783222:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783231:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a6bdf05/0x66475b4e8b85e723 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.783253:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3314:x1869066299252096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6809us (6873us total) trans 8589940084 rc 0/0 00010000:00010000:2.0:1782487587.783254:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.783260:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.783264:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393 00010000:00010000:2.0:1782487587.783273:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb454f51c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.783278:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783285:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.783286:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783292:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783301:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783303:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.783309:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783315:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ad96c5/0x66475b4e8b85e71c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783341:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783354:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783355:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783358:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.783363:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783366:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.783379:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417664 00010000:00010000:1.0:1782487587.783383:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.783384:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417664 00010000:00010000:1.0:1782487587.783387:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783391:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783397:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.783405:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 98 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.783415:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549183480/2, rc 0, transno 8589940746 00000100:00100000:2.0:1782487587.783431:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6289 00000100:00100000:1.0:1782487587.783432:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299251456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.783443:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294417664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1782487587.783446:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4700/2, rc 0, transno 8589940747 00010000:00010000:2.0:1782487587.783452:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.783453:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299251584:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.783460:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 98 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783472:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783476:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 98 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783493:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783503:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783505:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdcdc9e/0x66475b4e8b8567cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476056 expref: 98 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783523:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783532:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.783537:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.783537:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.783544:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783559:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783582:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.783598:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.783628:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.783636:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.783638:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2361:x1869066294417664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 196us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.783651:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6289 00010000:00010000:0.0:1782487587.783665:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.783688:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.783691:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.783695:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3314:x1869066299253888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5104us (5171us total) trans 8589940085 rc 0/0 00010000:00010000:2.0:1782487587.783710:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.783711:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16399 00010000:00010000:2.0:1782487587.783724:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783733:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.783749:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.783753:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.783758:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783766:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.783769:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783777:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783790:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783796:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2f0ea7/0x66475b4e8b85e762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783814:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.783819:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783825:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.783828:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783835:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783844:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783851:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e777 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783869:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.783873:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783879:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.783882:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783889:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783904:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.783910:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.783920:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:3317:x1869066299254784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2962us (3050us total) trans 8589940086 rc 0/0 00010000:00010000:1.0:1782487587.783925:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783928:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.783930:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16402 00010000:00010000:1.0:1782487587.783931:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783937:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.783943:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.783963:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558776d80/2, rc 0, transno 8589940086 00000100:00100000:2.0:1782487587.783970:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+74:3317:x1869066299252224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7820us (7889us total) trans 8589940087 rc 0/0 00000100:00100000:1.0:1782487587.783974:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299254784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.783981:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392 00000004:00080000:1.0:1782487587.783987:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e7b80/2, rc 0, transno 8589940087 00000100:00100000:1.0:1782487587.783994:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299252224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.784001:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1782487587.784012:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784013:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299255296:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.784032:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784041:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784046:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.784055:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784077:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.784104:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299255424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.784131:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.784145:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.784153:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784162:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.784167:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784169:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299255296 00000100:00100000:1.0:1782487587.784175:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299255296 00010000:00010000:0.0:1782487587.784179:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784204:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784213:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e73f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784214:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299255424 00000100:00100000:1.0:1782487587.784219:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299255424 00000100:00100000:1.0:1782487587.784241:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16403 00010000:00010000:0.0:1782487587.784249:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.784251:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3317:x1869066299255296:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.784254:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.784259:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+75:3317:x1869066299252736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7559us (7624us total) trans 8589940088 rc 0/0 00010000:00010000:0.0:1782487587.784260:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782487587.784268:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6141 count 1 00000100:00100000:2.0:1782487587.784270:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16394 00010000:00010000:1.0:1782487587.784284:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784294:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16404 00010000:00010000:1.0:1782487587.784301:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784306:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+74:3317:x1869066299255424:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.784316:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.784320:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1782487587.784324:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6138 count 1 00010000:00010000:1.0:1782487587.784324:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784341:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784349:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784357:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784367:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fa:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.784370:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 122 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784371:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.784379:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784390:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299255680:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.784404:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784416:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784428:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299255808:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.784433:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.784459:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.784466:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558774a80/2, rc 0, transno 8589940088 00000100:00100000:1.0:1782487587.784476:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299252736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.784503:0:200304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b59b76/0x66475b4e8b8568eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760d4 expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784517:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784519:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299254016:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.784536:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784542:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784545:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784562:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784563:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784582:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784592:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.784593:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784601:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.784604:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784629:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784638:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.784643:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784665:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.784672:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.784680:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784690:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7aa4e/0x66475b4e8b85e746 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784712:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.784715:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784722:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.784726:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784734:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784753:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784760:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e75b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.784781:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.784785:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.784789:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.784793:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3315:x1869066299252992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7588us (7796us total) trans 8589940089 rc 0/0 00000100:00100000:1.0:1782487587.784800:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16395 00010000:00010000:1.0:1782487587.784820:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.784842:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85647d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f4c expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.784852:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299253504:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.784865:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784874:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784883:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:3317:x1869066299253760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6542us (6670us total) trans 8589940090 rc 0/0 00010000:00010000:1.0:1782487587.784892:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.784898:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16398 00000004:00080000:0.0:1782487587.784900:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549167100/2, rc 0, transno 8589940090 00010000:00010000:1.0:1782487587.784910:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.784917:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.784919:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299253760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.784939:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299254912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.784940:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.784975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.785001:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299254912 00000100:00100000:2.0:1782487587.785005:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.785006:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299254912 00000100:00100000:2.0:1782487587.785037:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.785041:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16405 00000100:00100000:0.0:1782487587.785051:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3314:x1869066299254912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.785066:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6145 count 1 00000004:00080000:2.0:1782487587.785074:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549167b80/2, rc 0, transno 8589940745 00010000:00010000:0.0:1782487587.785081:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.785086:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299254272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.785099:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+75:3317:x1869066299253376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7198us (7507us total) trans 8589940091 rc 0/0 00010000:00010000:0.0:1782487587.785104:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 113 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.785106:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549165880/2, rc 0, transno 8589940085 00000100:00100000:1.0:1782487587.785110:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16396 00000100:00100000:2.0:1782487587.785116:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299253888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.785119:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1801:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.785123:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1801:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.785126:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.785129:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299255552 00000004:00080000:2.0:1782487587.785132:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4380/2, rc 0, transno 8589940084 00000100:00100000:1.0:1782487587.785135:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299255552 00000100:00100000:2.0:1782487587.785140:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299252096:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.785155:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 113 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.785156:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e6d80/2, rc 0, transno 8589940744 00000100:00100000:1.0:1782487587.785163:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16406 00000100:00100000:2.0:1782487587.785166:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299251712:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.785173:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 113 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.785175:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+75:3314:x1869066299255552:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.785183:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558776a00/2, rc 0, transno 8589940743 00000100:00100000:2.0:1782487587.785203:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299251200:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.785205:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6137 count 1 00000100:00100000:0.0:1782487587.785207:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299256064:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.785222:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.785224:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782487587.785236:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255168:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.785239:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 95 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785247:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f9:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.785251:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.785254:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.785266:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.785270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.785275:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 95 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785285:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 95 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.785290:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299255168 00000100:00100000:2.0:1782487587.785294:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.785297:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299255168 00000100:00100000:1.0:1782487587.785300:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299256192:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.785325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.785332:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.785351:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299255936 00000100:00100000:0.0:1782487587.785356:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299255936 00000100:00100000:0.0:1782487587.785386:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16407 00000100:00100000:0.0:1782487587.785397:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+71:3314:x1869066299255168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.785412:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6139 count 1 00000100:00100000:1.0:1782487587.785413:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16408 00000100:00100000:1.0:1782487587.785424:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3314:x1869066299255936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.785429:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.785437:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6140 count 1 00010000:00010000:0.0:1782487587.785444:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785451:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.785456:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 113 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785467:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 83 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.785469:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1782487587.785479:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.785481:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fc:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.785485:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.785485:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.785489:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0972255/0x66475b4e8b853bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4752e2 expref: 113 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785494:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.785521:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299254656:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.785531:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 112 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785535:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 83 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.785539:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.785557:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 112 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.785566:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785566:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 83 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.785577:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299257088:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.785590:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.785595:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299257216:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.785631:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.785639:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.785656:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.785659:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.785673:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.785678:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785686:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb5735d7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.785690:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785699:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785713:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785721:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002370b977/0x66475b4e8b85e74d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785748:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.785752:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785759:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.785762:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785770:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785781:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785787:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.785808:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.785810:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.785815:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.785832:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.785857:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+72:3316:x1869066299254528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5352us (5577us total) trans 8589940748 rc 0/0 00000100:00100000:1.0:1782487587.785867:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.785868:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.785878:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401 00010000:00010000:0.0:1782487587.785888:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 122 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.785891:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.785898:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256448 00000100:00100000:2.0:1782487587.785903:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256448 00000100:00100000:0.0:1782487587.785911:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299257344:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.785918:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.785933:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256960 00000100:00100000:2.0:1782487587.785937:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256960 00000100:00100000:0.0:1782487587.785943:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.785961:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16409 00000004:00080000:1.0:1782487587.785962:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547711880/2, rc 0, transno 8589940091 00000100:00100000:0.0:1782487587.785969:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16410 00000100:00100000:2.0:1782487587.785971:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+73:3317:x1869066299256448:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.785977:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299253376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.785982:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3317:x1869066299256960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.785984:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6140 count 1 00000100:00100000:1.0:1782487587.785988:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782487587.785996:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256320:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.785999:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.786001:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6144 count 1 00010000:00010000:2.0:1782487587.786016:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 122 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786017:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786026:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.786036:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.786044:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.786044:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.786055:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786059:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786071:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.786079:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1800:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.786085:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 122 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786085:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1800:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.786093:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.786103:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 122 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786114:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256320 00000100:00100000:2.0:1782487587.786118:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547711180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299257472:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.786119:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256320 00010000:00010000:0.0:1782487587.786121:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 122 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786136:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 122 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786146:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256832 00000100:00100000:0.0:1782487587.786150:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299257728:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.786151:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256832 00000100:00100000:2.0:1782487587.786153:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.786170:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16411 00010000:00010000:2.0:1782487587.786171:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.786179:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299256320:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.786185:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.786202:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16412 00002000:00080000:1.0:1782487587.786205:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6133 count 1 00000100:00100000:2.0:1782487587.786215:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299256832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.786220:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.786230:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6139 count 1 00010000:00010000:1.0:1782487587.786234:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 95 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786242:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f5:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.786245:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786245:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.786254:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786273:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 95 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786286:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 95 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786297:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299257856:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.786320:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.786341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.786346:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 95 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.786355:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fb:0x0].0x0 since=4s v=(0 0) 00000100:00100000:1.0:1782487587.786356:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299255680:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.786362:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.786368:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786375:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.786393:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 95 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.786394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.786396:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299256576:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.786413:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 95 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.786426:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299257984:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.786433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.786461:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.786465:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299257600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.786485:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417792 00000100:00100000:2.0:1782487587.786489:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417792 00000100:00100000:1.0:1782487587.786494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.786512:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786514:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.786525:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299256704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.786544:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294417920 00000100:00100000:2.0:1782487587.786548:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294417920 00000100:00100000:1.0:1782487587.786549:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.786563:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786587:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256576 00000100:00100000:2.0:1782487587.786592:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6290 00000100:00100000:1.0:1782487587.786593:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256576 00000100:00100000:2.0:1782487587.786603:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2361:x1869066294417792:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.786632:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.786633:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299257600 00000100:00100000:1.0:1782487587.786638:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299257600 00010000:00010000:2.0:1782487587.786639:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786654:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299256704 00010000:00010000:2.0:1782487587.786655:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786659:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299256704 00000100:00100000:1.0:1782487587.786677:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16413 00010000:00010000:2.0:1782487587.786678:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b853a14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47525d expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786688:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+80:3314:x1869066299256576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.786691:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414 00010000:00010000:2.0:1782487587.786694:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.786698:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.786702:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6136 count 1 00010000:00010000:2.0:1782487587.786705:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.786705:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+80:3314:x1869066299257600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.786714:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.786724:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6135 count 1 00010000:00010000:2.0:1782487587.786726:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786736:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 96 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786740:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786750:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.786752:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.786759:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.786767:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786773:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 96 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.786782:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2361:x1869066294417792:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 179us (440us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.786787:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f7:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.786791:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 96 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786793:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.786796:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6290 00010000:00010000:0.0:1782487587.786802:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786814:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 96 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786826:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299258112:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.786832:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 96 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.786845:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 96 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.786851:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6291 00000100:00100000:0.0:1782487587.786865:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299258240:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.786866:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.786867:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+96:2360:x1869066294417920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.786881:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.786887:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.786897:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16415 00010000:00010000:2.0:1782487587.786902:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 96 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.786902:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.786911:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3314:x1869066299256704:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.786927:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.786930:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6149 count 1 00010000:00010000:2.0:1782487587.786932:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.786938:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786943:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.786949:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.786975:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.786975:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 112 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.786984:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1805:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.786987:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.786990:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.787006:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+96:2360:x1869066294417920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 144us (613us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.787010:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 112 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.787028:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6291 00010000:00010000:1.0:1782487587.787032:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 112 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.787043:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299258368:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.787072:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.787083:0:213693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028a9ac49/0x66475b4e8b856d2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d0 expref: 95 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.787103:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299255808:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.787119:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787129:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787137:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787146:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787154:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787173:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.787181:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.787200:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.787209:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.787213:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.787228:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.787243:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.787251:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.787273:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.787278:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.787282:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.787367:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+81:3317:x1869066299255424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3064us (3233us total) trans 8589940092 rc 0/0 00000100:00100000:2.0:1782487587.787375:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16404 00000004:00080000:0.0:1782487587.787388:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a8380/2, rc 0, transno 8589940092 00000100:00100000:0.0:1782487587.787408:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299255424:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.787411:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547710e00/2, rc 0, transno 8589940089 00000100:00100000:2.0:1782487587.787418:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299252992:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.787435:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.787446:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787455:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.787462:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782487587.787466:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.787475:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299258496:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.787478:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.787480:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.787493:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299258624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.787500:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.787512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.787531:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299258496 00000100:00100000:1.0:1782487587.787536:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299258496 00000100:00100000:1.0:1782487587.787563:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16416 00000100:00100000:1.0:1782487587.787571:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+81:3314:x1869066299258496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.787583:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6141 count 1 00010000:00010000:1.0:1782487587.787596:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.787672:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 83 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.787679:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fd:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.787683:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.787687:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.787707:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 83 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.787716:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 83 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.787727:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299258752:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.787777:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3317:x1869066299255296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3526us (3730us total) trans 8589940749 rc 0/0 00000100:00100000:1.0:1782487587.787778:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.787788:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16403 00010000:00010000:2.0:1782487587.787816:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.787816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.787823:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787833:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.787838:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.787845:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548845c00/2, rc 0, transno 8589940749 00010000:00010000:2.0:1782487587.787848:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.787857:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299255296:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.787864:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787873:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e77e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787897:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.787898:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299258624 00010000:00010000:2.0:1782487587.787901:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.787902:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299258624 00010000:00010000:2.0:1782487587.787905:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.787931:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16417 00000100:00100000:1.0:1782487587.787939:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3317:x1869066299258624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.787950:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6142 count 1 00010000:00010000:1.0:1782487587.787962:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.787969:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1fdd06/0x66475b4e8b8536be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475184 expref: 121 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.787979:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 83 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.787985:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299253632:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.787995:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fe:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.788000:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.788001:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788004:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788021:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788030:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788036:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 83 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788042:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788052:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 83 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788072:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788077:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299259008:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.788097:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.788110:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.788114:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.788117:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.788128:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.788132:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788133:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299258880:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.788153:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788165:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.788168:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.788178:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e754 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.788208:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.788211:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.788214:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.788218:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299258880 00000100:00100000:1.0:1782487587.788222:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299258880 00000100:00100000:1.0:1782487587.788252:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418 00000100:00100000:1.0:1782487587.788259:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+76:3317:x1869066299258880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.788271:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6146 count 1 00010000:00010000:1.0:1782487587.788283:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788292:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3315:x1869066299253248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10294us (10587us total) trans 8589940750 rc 0/0 00010000:00010000:1.0:1782487587.788298:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 120 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788305:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16397 00010000:00010000:1.0:1782487587.788312:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1802:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.788316:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.788320:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788339:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 120 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788349:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788361:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299259136:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.788396:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447780 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.788425:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299257216:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.788440:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788465:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299257984:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.788472:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299257856:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.788484:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788492:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.788500:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299257088:192.168.202.21@tcp:104: 00000004:00080000:2.0:1782487587.788523:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573531880/2, rc 0, transno 8589940748 00000004:00080000:1.0:1782487587.788533:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547712300/2, rc 0, transno 8589940750 00000100:00100000:2.0:1782487587.788537:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299254528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.788541:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299253248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.788569:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299256064:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.788572:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299256192:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.788590:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.788592:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788640:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299259264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.788656:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299259392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.788677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.788691:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299257344:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.788716:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788730:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299259264 00000100:00100000:2.0:1782487587.788735:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299259264 00000100:00100000:1.0:1782487587.788765:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.788765:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299257728:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.788767:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16419 00000100:00100000:2.0:1782487587.788780:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3314:x1869066299259264:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.788785:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.788793:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6147 count 1 00000100:00100000:1.0:1782487587.788799:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299259392 00000100:00100000:1.0:1782487587.788802:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299259392 00010000:00010000:2.0:1782487587.788808:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788822:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788822:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16420 00000100:00100000:1.0:1782487587.788831:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3315:x1869066299259392:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.788838:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1803:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.788843:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1803:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.788844:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6148 count 1 00010000:00010000:2.0:1782487587.788848:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788854:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788866:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 120 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.788871:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788881:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1804:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.788887:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.788889:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788893:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.788911:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299259520:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.788941:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 120 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.788953:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 120 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.788965:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299259648:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.788968:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.788997:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547711180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299257472:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.789003:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.789013:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.789453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.789487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.789498:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418176 00000100:00100000:2.0:1782487587.789503:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418176 00000100:00100000:0.0:1782487587.789521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.789526:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 95 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.789555:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418432 00000100:00100000:0.0:1782487587.789555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.789559:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418432 00010000:00010000:2.0:1782487587.789573:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 96 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.789592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.789604:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418048 00000100:00100000:2.0:1782487587.789632:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418048 00010000:00010000:2.0:1782487587.789648:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 97 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.789667:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418688 00000100:00100000:2.0:1782487587.789669:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418688 00000100:00100000:1.0:1782487587.789671:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418304 00000100:00100000:1.0:1782487587.789678:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418304 00010000:00010000:2.0:1782487587.789683:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 113 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.789685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.789699:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.789701:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418944 00000100:00100000:2.0:1782487587.789706:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418944 00000100:00100000:0.0:1782487587.789714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.789722:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 121 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.789732:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6292 00000100:00100000:1.0:1782487587.789741:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2360:x1869066294418176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.789751:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.789753:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6293 00010000:00010000:1.0:1782487587.789760:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 97 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.789767:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2360:x1869066294418432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.789780:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 97 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.789781:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.789791:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 97 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.789802:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a052f195/0x66475b4e8b856d98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761ec expref: 97 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.789803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.789810:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 97 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.789818:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.789827:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.789837:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.789837:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.789847:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008384a35f/0x66475b4e8b856dc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47621d expref: 96 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.789850:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.789868:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.789873:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.789878:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.789880:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.789890:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.789892:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.789909:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+95:2360:x1869066294418176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (456us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.789911:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.789917:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.789921:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6292 00010000:00010000:0.0:1782487587.789928:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.789938:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418560 00010000:00010000:0.0:1782487587.789938:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.789943:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418560 00000100:00100000:2.0:1782487587.789945:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+94:2360:x1869066294418432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (456us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.789959:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 114 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.789962:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6293 00010000:00010000:0.0:1782487587.789965:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.789983:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294418816 00000100:00100000:1.0:1782487587.789984:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419072 00000100:00100000:2.0:1782487587.789989:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294418816 00000100:00100000:1.0:1782487587.789990:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419072 00010000:00010000:2.0:1782487587.790012:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790013:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 123 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790052:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6294 00000100:00100000:1.0:1782487587.790059:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6295 00000100:00100000:2.0:1782487587.790064:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2361:x1869066294418048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.790071:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+114:2360:x1869066294418688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.790074:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.790082:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 93 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790083:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.790092:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 114 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790101:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 93 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790108:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 114 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790125:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6daccc6/0x66475b4e8b856d9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476201 expref: 93 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790129:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b853fe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475401 expref: 114 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790145:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.790150:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.790151:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790158:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790166:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.790174:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+113:2360:x1869066294418688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.790182:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6295 00010000:00010000:2.0:1782487587.790203:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.790216:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6296 00000100:00100000:0.0:1782487587.790217:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+83:3317:x1869066299256320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4035us (4191us total) trans 8589940093 rc 0/0 00000100:00100000:1.0:1782487587.790229:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2361:x1869066294418304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.790231:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+92:2361:x1869066294418048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.790231:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16411 00010000:00010000:1.0:1782487587.790239:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.790245:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6294 00010000:00010000:1.0:1782487587.790247:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790259:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790263:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.790270:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790275:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6297 00010000:00010000:1.0:1782487587.790275:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b92d71/0x66475b4e8b856f90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476286 expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790283:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.790289:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790291:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+123:2360:x1869066294418944:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.790306:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.790314:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790315:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790316:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790324:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.790334:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790342:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790360:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790365:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790365:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85e7b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790382:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.790397:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cecbe3e/0x66475b4e8b853f46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753c2 expref: 123 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790400:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790403:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.790408:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.790413:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.790416:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1800:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.790416:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790423:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1800:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790432:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790435:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790448:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790452:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790473:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.790475:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.790498:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+122:2360:x1869066294418944:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 211us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.790506:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6297 00000100:00100000:2.0:1782487587.790527:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6298 00000100:00100000:2.0:1782487587.790537:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+112:2361:x1869066294418560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.790547:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.790547:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299258240:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.790557:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 112 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.790565:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790598:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 112 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790638:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382a9246/0x66475b4e8b853cb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47531a expref: 112 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790651:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1801:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790655:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1801:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790660:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.790665:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+83:3314:x1869066299255936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5240us (5339us total) trans 8589940094 rc 0/0 00010000:00010000:2.0:1782487587.790677:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.790681:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16408 00010000:00010000:2.0:1782487587.790706:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.790721:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299258368:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.790730:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294418560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (1018us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.790736:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790741:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6298 00000100:00100000:2.0:1782487587.790768:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6299 00000100:00100000:1.0:1782487587.790774:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299258752:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.790780:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+121:2361:x1869066294418816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.790789:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790790:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.790799:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 121 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.790819:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299259008:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.790821:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 121 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790832:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790841:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730939a4/0x66475b4e8b8536e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47518b expref: 121 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790854:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.790859:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fb:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.790859:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299259136:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.790868:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.790873:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.790879:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.790904:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558777b80/2, rc 0, transno 8589940093 00010000:00010000:2.0:1782487587.790906:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.790917:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.790922:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790936:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2361:x1869066294418816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (1135us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.790942:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790948:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6299 00010000:00010000:0.0:1782487587.790959:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.790968:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782487587.790968:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.790970:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6300 00000100:00100000:1.0:1782487587.790980:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299259776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.790983:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2361:x1869066294419072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.790991:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.790994:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.791001:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 119 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.791013:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.791026:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 119 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791042:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.791043:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fac570a/0x66475b4e8b853a22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475264 expref: 119 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791050:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791059:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.791067:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.791071:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.791074:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791077:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791094:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791096:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791120:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791124:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.791129:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85e7a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.791149:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2361:x1869066294419072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (1312us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.791150:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.791156:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.791162:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6300 00010000:00010000:1.0:1782487587.791169:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.791173:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791180:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791204:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791210:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+78:3314:x1869066299255168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5813us (5939us total) trans 8589940751 rc 0/0 00010000:00010000:2.0:1782487587.791216:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.791217:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85e79a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791227:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16407 00010000:00010000:2.0:1782487587.791237:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791240:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.791244:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.791248:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.791252:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791252:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299259776 00000100:00100000:0.0:1782487587.791259:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299259776 00010000:00010000:1.0:1782487587.791260:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791283:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791283:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791295:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16421 00010000:00010000:2.0:1782487587.791306:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791307:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791311:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+83:3317:x1869066299259776:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.791333:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.791336:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6145 count 1 00010000:00010000:2.0:1782487587.791340:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.791352:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.791355:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.791370:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 83 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.791378:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1801:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.791382:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1801:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.791387:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.791413:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 83 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.791425:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 83 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791438:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299259904:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.791492:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.791571:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+84:3314:x1869066299255552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6398us (6535us total) trans 8589940095 rc 0/0 00000100:00100000:1.0:1782487587.791579:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16406 00000100:00100000:2.0:1782487587.791600:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299256960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5620us (5681us total) trans 8589940752 rc 0/0 00010000:00010000:1.0:1782487587.791602:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.791626:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791641:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.791645:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16410 00010000:00010000:1.0:1782487587.791647:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791656:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791667:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791670:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.791677:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2361:x1869066294418304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1448us (2080us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.791679:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791680:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e7af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.791698:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6296 00010000:00010000:2.0:1782487587.791706:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.791711:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791712:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.791717:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.791722:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.791723:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791739:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.791745:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547713b80/2, rc 0, transno 8589940752 00010000:00010000:2.0:1782487587.791748:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.791759:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256960:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.791772:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.791776:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.791781:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.791798:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791807:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.791810:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260032:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.791824:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.791833:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.791844:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.791853:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.791903:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791913:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791922:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791930:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.791942:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.792019:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3314:x1869066299254912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6970us (7044us total) trans 8589940753 rc 0/0 00000100:00100000:2.0:1782487587.792027:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16405 00000100:00100000:2.0:1782487587.792045:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260032 00000100:00100000:2.0:1782487587.792048:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260032 00000100:00100000:2.0:1782487587.792081:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16422 00000100:00100000:2.0:1782487587.792090:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3317:x1869066299260032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.792102:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6150 count 1 00010000:00010000:2.0:1782487587.792115:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792118:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3317:x1869066299256832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5906us (6048us total) trans 8589940096 rc 0/0 00010000:00010000:2.0:1782487587.792136:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 110 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792136:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16412 00010000:00010000:2.0:1782487587.792146:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1806:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.792149:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.792154:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.792167:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558777800/2, rc 0, transno 8589940096 00010000:00010000:2.0:1782487587.792174:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 110 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792177:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.792208:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 110 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.792220:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299260160:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.792239:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.792249:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.792277:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.792283:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.792298:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.792304:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792312:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.792317:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792317:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260288 00000100:00100000:1.0:1782487587.792323:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260288 00010000:00010000:2.0:1782487587.792334:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792346:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792348:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16423 00010000:00010000:2.0:1782487587.792359:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362b80ea/0x66475b4e8b85e78c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792360:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+84:3315:x1869066299260288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.792377:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6143 count 1 00010000:00010000:2.0:1782487587.792385:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.792390:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.792392:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792405:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.792412:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.792417:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 82 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792427:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.792447:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ff:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.792451:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.792453:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.792456:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792471:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85e7bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.792485:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 82 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792498:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.792498:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792502:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.792506:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.792513:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299260416:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.792532:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792542:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792548:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.792551:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792560:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792577:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782487587.792581:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548844e00/2, rc 0, transno 8589940751 00000100:00100000:1.0:1782487587.792593:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255168:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.792636:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558777480/2, rc 0, transno 8589940094 00000100:00100000:1.0:1782487587.792644:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255936:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.792656:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a8000/2, rc 0, transno 8589940753 00000100:00100000:1.0:1782487587.792661:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299254912:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.792672:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434ab480/2, rc 0, transno 8589940095 00000100:00100000:1.0:1782487587.792676:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299255552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.792764:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+79:3317:x1869066299256448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6795us (6900us total) trans 8589940754 rc 0/0 00000100:00100000:2.0:1782487587.792773:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16409 00010000:00010000:2.0:1782487587.792796:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.792801:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792806:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260544:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.792814:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.792820:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792830:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792839:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.792845:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.792854:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e7a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792860:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.792868:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260928:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.792873:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.792877:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.792879:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.792893:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260544 00000100:00100000:1.0:1782487587.792894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.792897:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260544 00000100:00100000:1.0:1782487587.792926:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260928 00000100:00100000:2.0:1782487587.792931:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16424 00000100:00100000:1.0:1782487587.792932:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260928 00000100:00100000:2.0:1782487587.792941:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3315:x1869066299260544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.792953:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6144 count 1 00000100:00100000:1.0:1782487587.792963:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16425 00010000:00010000:2.0:1782487587.792967:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.792974:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:3315:x1869066299260928:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.792985:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.792990:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6152 count 1 00010000:00010000:2.0:1782487587.792995:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1800:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.792999:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1800:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.793004:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793005:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793027:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 117 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.793033:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793039:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1808:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.793048:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.793053:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793054:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.793078:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299261056:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.793091:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 117 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793101:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 117 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.793118:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547687b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299261184:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.793132:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.793164:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.793185:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.793220:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.793249:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573533480/2, rc 0, transno 8589940754 00000100:00100000:1.0:1782487587.793256:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299256448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.793263:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.793268:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.793286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.793326:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299261312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.793345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.793374:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260800 00000100:00100000:1.0:1782487587.793374:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299260672 00000100:00100000:2.0:1782487587.793380:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260800 00000100:00100000:1.0:1782487587.793381:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299260672 00000100:00100000:2.0:1782487587.793414:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299261312 00000100:00100000:2.0:1782487587.793419:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299261312 00000100:00100000:1.0:1782487587.793423:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16426 00000100:00100000:1.0:1782487587.793434:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3317:x1869066299260800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.793445:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6151 count 1 00000100:00100000:2.0:1782487587.793450:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16427 00010000:00010000:1.0:1782487587.793457:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.793462:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+86:3317:x1869066299260672:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.793476:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 110 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.793478:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6147 count 1 00010000:00010000:1.0:1782487587.793488:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1807:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.793491:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1807:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.793494:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793496:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.793520:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 91 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.793529:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1803:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.793530:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 110 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.793536:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1803:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.793545:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793550:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 110 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.793567:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547686a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299261440:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.793578:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 91 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.793591:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 91 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.793599:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.793604:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558775f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299261568:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.793633:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.793672:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299259520:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.793688:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.793713:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.793721:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16428 00000100:00100000:1.0:1782487587.793731:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+81:3315:x1869066299261312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.793742:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6153 count 1 00010000:00010000:1.0:1782487587.793752:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793762:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 117 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793775:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 117 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793782:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1809:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.793785:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.793789:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793805:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 117 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793814:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 117 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.793825:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547685180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299261696:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.793871:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 117 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.793878:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 117 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.793886:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299261824:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.793913:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.794087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.794119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.794129:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419328 00000100:00100000:2.0:1782487587.794134:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419328 00000100:00100000:1.0:1782487587.794150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.794159:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 111 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.794179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.794199:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419584 00000100:00100000:2.0:1782487587.794203:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419584 00010000:00010000:2.0:1782487587.794220:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 83 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.794221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.794247:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419840 00000100:00100000:1.0:1782487587.794248:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.794250:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419200 00000100:00100000:2.0:1782487587.794253:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419840 00000100:00100000:0.0:1782487587.794257:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419200 00010000:00010000:2.0:1782487587.794271:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.794282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.794282:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 92 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.794291:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419456 00000100:00100000:2.0:1782487587.794296:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419456 00000100:00100000:0.0:1782487587.794309:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419712 00010000:00010000:2.0:1782487587.794313:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 84 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794315:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419712 00000100:00100000:2.0:1782487587.794334:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294419968 00000100:00100000:1.0:1782487587.794335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.794336:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 119 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.794340:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294419968 00010000:00010000:2.0:1782487587.794359:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 93 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794361:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420096 00000100:00100000:1.0:1782487587.794362:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299258112:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.794368:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420096 00010000:00010000:1.0:1782487587.794380:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794389:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 120 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.794390:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6301 00000100:00100000:2.0:1782487587.794402:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294419328:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.794405:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299259648:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.794415:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.794415:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6302 00010000:00010000:1.0:1782487587.794417:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794423:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 111 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794428:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2361:x1869066294419584:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.794443:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.794445:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 111 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794452:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794466:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429c68d3/0x66475b4e8b854168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47545c expref: 111 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794468:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794487:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.794491:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.794498:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794498:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bdd4b2c/0x66475b4e8b85723e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476358 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794523:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794529:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.794535:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.794541:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794547:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.794551:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794566:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794576:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794581:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.794588:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.794589:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794630:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794634:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2361:x1869066294419584:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 185us (490us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.794638:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.794661:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.794662:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794664:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6302 00010000:00010000:1.0:1782487587.794675:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794686:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6303 00010000:00010000:1.0:1782487587.794691:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.794697:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+120:2361:x1869066294419840:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.794707:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.794715:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.794716:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6304 00010000:00010000:0.0:1782487587.794732:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.794739:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2360:x1869066294419200:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.794754:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072d7e66a/0x66475b4e8b8542bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754c5 expref: 120 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.794755:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.794765:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794771:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1803:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.794780:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1803:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.794787:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794788:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.794810:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.794819:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a52b2456/0x66475b4e8b856e24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476239 expref: 93 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.794833:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.794833:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.794839:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.794845:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.794853:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.794861:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+119:2361:x1869066294419840:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.794869:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6303 00000100:00100000:0.0:1782487587.794887:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6305 00010000:00010000:3.0:1782487587.794891:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.794897:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2360:x1869066294419456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.794907:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.794912:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3314:x1869066299256704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8003us (8360us total) trans 8589940755 rc 0/0 00010000:00010000:0.0:1782487587.794917:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.794923:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16415 00000100:00100000:1.0:1782487587.794931:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+87:3317:x1869066299258624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6988us (7113us total) trans 8589940097 rc 0/0 00000100:00100000:3.0:1782487587.794932:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+92:2360:x1869066294419200:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 199us (748us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.794939:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.794950:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16417 00000100:00100000:3.0:1782487587.794951:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6304 00000100:00100000:2.0:1782487587.794963:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6306 00010000:00010000:0.0:1782487587.794968:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676c7e00/0x66475b4e8b857230 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476343 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.794977:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+118:2360:x1869066294419712:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.794983:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6307 00010000:00010000:0.0:1782487587.794983:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.794990:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1782487587.794990:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79180/2, rc 0, transno 8589940097 00010000:00010000:0.0:1782487587.794991:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17fd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.794999:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+91:2360:x1869066294419968:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.795003:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795003:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299258624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.795004:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795010:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.795021:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 91 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795030:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795034:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795038:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1782487587.795044:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 91 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795049:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299261952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.795071:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d873e357/0x66475b4e8b853f4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4753d7 expref: 118 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795071:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.795076:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3653f23/0x66475b4e8b856db4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47620f expref: 91 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795080:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.795098:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1802:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.795098:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2360:x1869066294419456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (875us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.795105:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.795106:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795108:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.795114:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6305 00010000:00010000:2.0:1782487587.795116:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795119:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.795129:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795132:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.795136:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6308 00010000:00010000:2.0:1782487587.795139:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.795150:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2360:x1869066294420096:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.795157:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795161:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795166:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.795175:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.795176:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 117 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795182:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.795210:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.795210:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+117:2360:x1869066294419712:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 236us (961us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.795215:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 117 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795216:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1782487587.795222:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6306 00000100:00100000:3.0:1782487587.795235:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2360:x1869066294419968:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 241us (955us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.795242:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047c26ec5/0x66475b4e8b8542e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4754b0 expref: 116 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.795243:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6307 00010000:00010000:2.0:1782487587.795248:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.795256:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795261:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.795268:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.795269:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.795274:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795277:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.795284:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2361:x1869066294419328:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 884us (1197us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.795291:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.795302:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6301 00010000:00010000:0.0:1782487587.795304:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795337:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+87:3314:x1869066299258496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7763us (7822us total) trans 8589940098 rc 0/0 00010000:00010000:2.0:1782487587.795338:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795342:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.795360:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85e7d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795365:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16416 00000100:00100000:0.0:1782487587.795368:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2360:x1869066294420096:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 219us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.795383:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6308 00000100:00100000:1.0:1782487587.795385:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299261952 00010000:00010000:2.0:1782487587.795388:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1782487587.795392:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299261952 00010000:00010000:2.0:1782487587.795393:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795402:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.795406:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795408:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795421:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795421:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16429 00010000:00010000:0.0:1782487587.795431:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795434:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+87:3317:x1869066299261952:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.795440:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.795454:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6146 count 1 00010000:00010000:0.0:1782487587.795455:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795456:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001315c60e/0x66475b4e8b85e7e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795469:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795482:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795486:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.795489:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 89 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795492:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.795500:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.795512:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1802:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.795513:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.795519:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795519:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.795528:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795533:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795549:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795558:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85e7d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795558:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 89 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795585:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 89 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795586:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.795591:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795626:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.795627:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299262080:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.795631:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795641:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795652:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795662:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e7cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.795662:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.795673:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+88:3314:x1869066299257600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8970us (9177us total) trans 8589940099 rc 0/0 00010000:00010000:1.0:1782487587.795683:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.795683:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414 00010000:00010000:2.0:1782487587.795684:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.795687:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.795691:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.795697:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795701:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.795709:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795713:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795719:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795729:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795742:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.795743:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.795754:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.795770:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.795961:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+88:3314:x1869066299256576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9276us (9530us total) trans 8589940100 rc 0/0 00000100:00100000:1.0:1782487587.795968:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16413 00000100:00100000:2.0:1782487587.795993:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+82:3317:x1869066299258880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7733us (7826us total) trans 8589940756 rc 0/0 00010000:00010000:1.0:1782487587.795994:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.796006:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.796007:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418 00010000:00010000:1.0:1782487587.796017:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.796022:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796035:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.796036:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.796043:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796058:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.796063:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796072:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796086:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796094:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85e7c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796116:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.796120:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796128:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.796133:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796141:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796154:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796163:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85e7e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796178:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3315:x1869066299259392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7346us (7415us total) trans 8589940757 rc 0/0 00010000:00010000:2.0:1782487587.796181:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.796186:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796198:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16420 00010000:00010000:2.0:1782487587.796208:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.796212:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796221:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796232:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.796234:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573531180/2, rc 0, transno 8589940757 00010000:00010000:2.0:1782487587.796244:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85e7f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796249:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299259392:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.796264:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.796267:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.796269:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.796276:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.796281:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.796298:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299262208:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.796299:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.796325:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a8a80/2, rc 0, transno 8589940098 00000100:00100000:2.0:1782487587.796333:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.796339:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299258496:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.796360:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549164380/2, rc 0, transno 8589940755 00000100:00100000:1.0:1782487587.796372:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299256704:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.796373:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79880/2, rc 0, transno 8589940756 00000100:00100000:2.0:1782487587.796382:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299258880:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.796394:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558775500/2, rc 0, transno 8589940100 00000100:00100000:1.0:1782487587.796402:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299256576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.796416:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262208 00000004:00080000:1.0:1782487587.796419:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770f100/2, rc 0, transno 8589940099 00000100:00100000:2.0:1782487587.796421:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262208 00000100:00100000:1.0:1782487587.796427:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299257600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.796453:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16430 00000100:00100000:2.0:1782487587.796463:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+82:3317:x1869066299262208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.796480:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6157 count 1 00010000:00010000:2.0:1782487587.796493:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796507:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 109 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.796510:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299259904:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.796522:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180d:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.796527:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.796533:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.796533:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796538:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.796547:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.796574:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 109 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796588:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 109 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796589:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.796595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.796632:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299262976:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.796648:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782487587.796658:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.796672:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.796686:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262464 00000100:00100000:2.0:1782487587.796691:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262464 00000100:00100000:1.0:1782487587.796691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.796718:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.796720:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262336 00000100:00100000:2.0:1782487587.796725:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262336 00000100:00100000:2.0:1782487587.796757:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16431 00000100:00100000:1.0:1782487587.796762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.796770:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+89:3315:x1869066299262464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.796781:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6148 count 1 00010000:00010000:2.0:1782487587.796794:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796805:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 89 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796813:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1804:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.796817:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.796821:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796842:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 89 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.796844:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299260416:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.796863:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 89 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.796872:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.796887:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299263104:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.796905:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262848 00000100:00100000:1.0:1782487587.796910:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262848 00000100:00100000:2.0:1782487587.796927:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.796944:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16432 00000100:00100000:2.0:1782487587.796951:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16433 00000100:00100000:1.0:1782487587.796956:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+89:3315:x1869066299262336:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.796959:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420352 00000100:00100000:2.0:1782487587.796965:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+83:3315:x1869066299262848:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.796966:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420352 00002000:00080000:1.0:1782487587.796972:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6149 count 1 00002000:00080000:2.0:1782487587.796982:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6158 count 1 00010000:00010000:1.0:1782487587.796984:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.796995:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 89 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.796996:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797011:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1805:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.797017:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.797018:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797027:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797030:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180e:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.797038:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.797044:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797058:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 89 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797069:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797073:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 89 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797088:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.797111:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299263232:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.797112:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299263360:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.797161:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.797173:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.797202:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547686a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299261440:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.797207:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420224 00000100:00100000:2.0:1782487587.797212:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420224 00000100:00100000:0.0:1782487587.797217:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.797218:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797232:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 81 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797252:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 110 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797256:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420608 00000100:00100000:1.0:1782487587.797258:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547687b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299261184:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.797261:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420608 00010000:00010000:1.0:1782487587.797280:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797281:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.797324:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797332:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797340:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.797347:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6309 00010000:00010000:1.0:1782487587.797352:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797361:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420864 00000100:00100000:3.0:1782487587.797365:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2360:x1869066294420224:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.797366:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420864 00010000:00010000:1.0:1782487587.797370:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.797379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.797380:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.797383:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 111 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797391:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 82 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797402:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421120 00000100:00100000:2.0:1782487587.797406:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421120 00010000:00010000:3.0:1782487587.797410:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 82 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.797422:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 115 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797436:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421376 00000100:00100000:2.0:1782487587.797439:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421376 00000100:00100000:0.0:1782487587.797443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.797457:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 90 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797467:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420480 00010000:00010000:3.0:1782487587.797469:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c51d54/0x66475b4e8b857405 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1801:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763eb expref: 82 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797473:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420480 00000100:00100000:2.0:1782487587.797480:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6310 00010000:00010000:3.0:1782487587.797487:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1801:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.797493:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294420352:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.797494:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1801:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.797497:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797506:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797507:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.797516:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 111 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797517:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797529:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6311 00010000:00010000:2.0:1782487587.797546:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 111 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797547:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2361:x1869066294420608:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.797553:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.797555:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb573530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3314:x1869066299259264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8775us (8877us total) trans 8589940758 rc 0/0 00010000:00010000:0.0:1782487587.797565:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.797574:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797575:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1806:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.797575:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16419 00000100:00100000:3.0:1782487587.797579:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2360:x1869066294420224:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 219us (990us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.797584:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.797595:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.797596:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6309 00010000:00010000:0.0:1782487587.797602:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797631:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.797644:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6312 00010000:00010000:2.0:1782487587.797649:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.797654:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1800:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.797655:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294420864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.797660:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1800:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.797665:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.797665:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.797666:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299262080:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.797674:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 111 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797676:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+111:2361:x1869066294420352:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 184us (1132us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.797684:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.797685:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797691:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6310 00000100:00100000:2.0:1782487587.797710:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6313 00010000:00010000:3.0:1782487587.797718:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 110 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.797719:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.797720:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.797724:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2361:x1869066294421120:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.797726:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797738:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.797742:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2361:x1869066294420608:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 199us (528us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.797747:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.797748:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 115 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797752:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797754:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005720ad4d/0x66475b4e8b85484c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4756a1 expref: 110 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797756:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6311 00010000:00010000:1.0:1782487587.797778:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797780:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1807:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.797788:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6314 00010000:00010000:3.0:1782487587.797790:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1807:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.797795:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 115 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797798:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797799:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2361:x1869066294421376:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.797803:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.797814:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.797822:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 90 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.797823:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85e7ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797829:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.797850:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 90 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797851:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2361:x1869066294421120:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 132us (471us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.797853:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.797858:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.797863:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.797868:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6313 00010000:00010000:0.0:1782487587.797880:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b8579c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1802:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476622 expref: 90 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797884:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.797889:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6315 00000004:00080000:1.0:1782487587.797889:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb573531500/2, rc 0, transno 8589940758 00000100:00100000:2.0:1782487587.797903:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2360:x1869066294420480:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.797904:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1802:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.797905:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb573531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299259264:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.797912:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1802:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.797917:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.797917:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.797918:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.797927:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 80 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.797929:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.797944:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+109:2361:x1869066294420864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 291us (665us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.797952:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 80 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.797958:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6312 00010000:00010000:1.0:1782487587.797959:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.797965:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.797975:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.797979:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c72d81/0x66475b4e8b8575a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476493 expref: 80 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.797994:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+89:2361:x1869066294421376:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 194us (582us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.797998:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798002:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.798009:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17ff:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.798012:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6314 00010000:00010000:2.0:1782487587.798019:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798022:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.798037:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798051:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.798055:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798056:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.798071:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798078:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.798081:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.798100:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.798102:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2360:x1869066294420480:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.798110:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6315 00010000:00010000:2.0:1782487587.798133:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798143:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798152:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798160:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798174:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.798257:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3317:x1869066299260800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4825us (5035us total) trans 8589940759 rc 0/0 00000100:00100000:1.0:1782487587.798265:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16426 00010000:00010000:1.0:1782487587.798292:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798302:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798311:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798321:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798333:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1782487587.798342:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+91:3317:x1869066299259776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7035us (7330us total) trans 8589940101 rc 0/0 00000100:00100000:0.0:1782487587.798350:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16421 00000100:00100000:2.0:1782487587.798375:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+90:3315:x1869066299260288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6015us (6093us total) trans 8589940102 rc 0/0 00000100:00100000:2.0:1782487587.798382:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16423 00000100:00100000:0.0:1782487587.798402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.798408:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782487587.798413:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798423:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.798427:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798437:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798450:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798458:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85e81f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.798465:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420736 00000100:00100000:3.0:1782487587.798470:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420736 00000100:00100000:0.0:1782487587.798474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.798478:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1782487587.798478:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+90:3317:x1869066299261952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3044us (3398us total) trans 8589940103 rc 0/0 00010000:00010000:2.0:1782487587.798485:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798489:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16429 00010000:00010000:3.0:1782487587.798494:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 89 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798501:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.798508:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798511:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.798517:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798520:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.798527:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294420992 00000100:00100000:0.0:1782487587.798530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.798534:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294420992 00010000:00010000:1.0:1782487587.798535:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.798542:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798547:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798550:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798566:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2d8c439/0x66475b4e8b85e7fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1801:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798571:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798581:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000398a8eb2/0x66475b4e8b85e80a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798583:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.798590:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798598:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.798603:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.798622:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.798626:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.798629:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.798643:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299263488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.798650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.798669:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798674:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.798685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.798689:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798698:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85e834 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1802:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.798703:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7ad80/2, rc 0, transno 8589940102 00000100:00100000:1.0:1782487587.798712:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260288:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.798713:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.798717:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.798722:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.798733:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421248 00010000:00010000:3.0:1782487587.798738:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 115 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.798739:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421248 00010000:00010000:1.0:1782487587.798752:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.798757:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.798760:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 116 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.798768:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421504 00000100:00100000:1.0:1782487587.798777:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299263232:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.798780:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421632 00000100:00100000:2.0:1782487587.798785:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421632 00000100:00100000:0.0:1782487587.798786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.798788:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798799:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 90 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798807:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299262592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.798808:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421504 00000100:00100000:2.0:1782487587.798820:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421760 00000100:00100000:0.0:1782487587.798820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.798825:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421760 00010000:00010000:3.0:1782487587.798830:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 109 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.798844:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294421888 00010000:00010000:2.0:1782487587.798847:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 91 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798849:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.798850:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294421888 00000100:00100000:3.0:1782487587.798852:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6316 00000100:00100000:3.0:1782487587.798865:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+91:2360:x1869066294420736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.798870:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.798874:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.798879:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6317 00000100:00100000:1.0:1782487587.798880:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299263616:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.798883:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 91 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.798895:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2360:x1869066294420992:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.798896:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6318 00010000:00010000:3.0:1782487587.798900:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 91 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798911:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.798911:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+116:2360:x1869066294421248:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.798916:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1803:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.798916:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.798921:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 116 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.798923:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1803:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.798923:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.798932:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.798935:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 116 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798940:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1782487587.798947:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 116 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798952:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299262720:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.798955:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.798977:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.798986:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.798987:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 116 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.798988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.798990:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.798993:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799009:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff797e8/0x66475b4e8b854b24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757c7 expref: 116 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799013:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.799019:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+91:2360:x1869066294420736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 155us (618us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.799021:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1808:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.799023:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299263488 00000100:00100000:1.0:1782487587.799028:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299263488 00010000:00010000:0.0:1782487587.799031:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1808:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.799035:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6316 00010000:00010000:0.0:1782487587.799037:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799040:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.799044:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.799050:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262592 00000100:00100000:1.0:1782487587.799053:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262592 00000100:00100000:3.0:1782487587.799062:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6319 00010000:00010000:0.0:1782487587.799063:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.799068:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2360:x1869066294420992:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.799073:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299263616 00000100:00100000:1.0:1782487587.799078:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299263616 00000100:00100000:2.0:1782487587.799079:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6317 00000100:00100000:3.0:1782487587.799080:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2360:x1869066294421632:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.799088:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+115:2360:x1869066294421248:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 181us (564us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.799093:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.799093:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299262720 00000100:00100000:1.0:1782487587.799098:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299262720 00000100:00100000:0.0:1782487587.799098:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6318 00010000:00010000:3.0:1782487587.799103:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 90 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.799109:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6320 00010000:00010000:3.0:1782487587.799120:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 90 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.799123:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16434 00000100:00100000:2.0:1782487587.799127:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066294421504:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.799138:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3315:x1869066299263488:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.799140:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6321 00010000:00010000:2.0:1782487587.799141:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.799145:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.799150:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1804:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.799151:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 110 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.799153:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6155 count 1 00000100:00100000:0.0:1782487587.799155:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2360:x1869066294421760:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.799158:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799166:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799169:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.799178:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 90 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799181:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799185:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 110 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799204:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 113 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799229:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.799232:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180b:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.799240:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.799242:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.799247:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799247:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799248:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 90 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799249:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.799269:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2360:x1869066294421632:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (583us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.799276:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.799280:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6319 00010000:00010000:0.0:1782487587.799284:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e23f7d11/0x66475b4e8b857c39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1805:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d1 expref: 90 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799286:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 113 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.799298:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6322 00000100:00100000:3.0:1782487587.799310:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066294421888:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.799317:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 113 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799317:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.799323:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.799326:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1805:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.799327:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.799332:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799339:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.799342:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299263744:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.799345:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 110 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.799353:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+110:2360:x1869066294421504:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 230us (701us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.799364:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.799370:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6320 00010000:00010000:3.0:1782487587.799371:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.799376:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.799380:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799386:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.799388:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.799390:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.799409:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.799411:0:213223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457a2dbe/0x66475b4e8b854f29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475902 expref: 109 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.799414:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2360:x1869066294421760:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 263us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.799418:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16435 00000100:00100000:1.0:1782487587.799432:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+91:3316:x1869066299262592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.799433:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6321 00000100:00100000:2.0:1782487587.799436:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299263360:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.799437:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+108:2360:x1869066294421888:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 124us (616us total) trans 0 rc 0/0 00002000:00080000:1.0:1782487587.799449:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6151 count 1 00000100:00100000:3.0:1782487587.799456:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6322 00010000:00010000:2.0:1782487587.799456:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799460:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799475:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799479:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799491:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799492:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1807:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.799501:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1807:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.799508:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799510:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799524:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799529:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799539:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799543:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.799551:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299263872:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.799587:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.799602:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799622:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799628:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799637:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799656:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487587.799754:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16436 00000100:00100000:2.0:1782487587.799766:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+86:3315:x1869066299262848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2804us (3010us total) trans 8589940760 rc 0/0 00000100:00100000:3.0:1782487587.799769:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+91:3316:x1869066299263616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.799779:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16433 00000100:00100000:2.0:1782487587.799801:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16437 00000100:00100000:2.0:1782487587.799810:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+86:3316:x1869066299262720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.799824:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6154 count 1 00010000:00010000:2.0:1782487587.799837:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799850:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 113 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799858:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180a:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.799861:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.799866:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.799872:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3315:x1869066299260928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6897us (6975us total) trans 8589940761 rc 0/0 00000100:00100000:1.0:1782487587.799883:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16425 00002000:00080000:3.0:1782487587.799891:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6150 count 1 00010000:00010000:2.0:1782487587.799892:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 113 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.799906:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 113 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799909:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.799928:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299264000:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.799933:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.799934:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 87 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.799940:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799947:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1806:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.799956:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.799957:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.799964:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.799965:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.799975:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898de40 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.799989:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800005:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 87 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800006:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800011:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa16bb34/0x66475b4e8b857896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1804:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476565 expref: 87 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800034:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800036:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 87 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.800042:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299263104:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.800065:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800072:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.800077:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800078:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800095:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800098:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.800105:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.800107:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299264128:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.800110:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800130:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800131:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.800157:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9300 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.800160:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800162:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.800173:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85e818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800206:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.800209:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceea230a/0x66475b4e8b85478f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475662 expref: 107 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800212:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800235:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.800241:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.800247:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558777100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299260160:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.800252:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800270:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800275:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800284:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800287:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e842 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1804:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800303:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800313:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800317:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.800321:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800322:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.800328:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.800338:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:3315:x1869066299262464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3571us (3752us total) trans 8589940104 rc 0/0 00010000:00010000:1.0:1782487587.800340:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.800342:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.800354:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16431 00010000:00010000:1.0:1782487587.800355:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800367:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800375:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.800375:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800383:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800395:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.800399:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.800404:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800414:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800428:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800436:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800456:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.800460:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800468:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.800473:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800482:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800496:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800506:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85e849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1805:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.800528:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.800532:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.800536:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.800553:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.800578:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87c380/2, rc 0, transno 8589940760 00000100:00100000:2.0:1782487587.800590:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262848:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.800627:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87d880/2, rc 0, transno 8589940104 00000100:00100000:2.0:1782487587.800639:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.800647:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+92:3315:x1869066299262336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3692us (3957us total) trans 8589940105 rc 0/0 00000004:00080000:2.0:1782487587.800656:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547684700/2, rc 0, transno 8589940761 00000100:00100000:1.0:1782487587.800657:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16432 00000100:00100000:2.0:1782487587.800665:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260928:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.800682:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87d180/2, rc 0, transno 8589940105 00010000:00010000:1.0:1782487587.800686:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.800687:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299262336:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.800696:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.800735:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b854bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475814 expref: 113 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.800753:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547685180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299261696:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.800774:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1a4e4d/0x66475b4e8b854bcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47580d expref: 112 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.800797:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547685880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299261824:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.800798:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299264512:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.800821:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800833:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.800836:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.800846:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800857:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.800866:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.800874:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487587.800883:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299264384:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.800885:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.800925:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3317:x1869066299260032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8833us (9081us total) trans 8589940762 rc 0/0 00000100:00100000:2.0:1782487587.800925:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.800940:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16422 00000100:00100000:0.0:1782487587.800940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.800965:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299264512 00000100:00100000:3.0:1782487587.800970:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299264512 00000100:00100000:2.0:1782487587.800975:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299264000:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.800986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.800993:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801018:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422016 00000100:00100000:2.0:1782487587.801021:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422016 00010000:00010000:2.0:1782487587.801041:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 112 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.801044:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299264384 00000100:00100000:3.0:1782487587.801049:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299264384 00000100:00100000:0.0:1782487587.801054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.801067:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422144 00000100:00100000:2.0:1782487587.801072:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422144 00000100:00100000:1.0:1782487587.801079:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+87:3315:x1869066299261312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7349us (7731us total) trans 8589940763 rc 0/0 00000100:00100000:3.0:1782487587.801088:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16438 00010000:00010000:2.0:1782487587.801089:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.801103:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16428 00000100:00100000:3.0:1782487587.801105:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+87:3315:x1869066299264512:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.801117:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422272 00000100:00100000:2.0:1782487587.801121:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6323 00000100:00100000:0.0:1782487587.801124:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422272 00000100:00100000:1.0:1782487587.801129:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16439 00000100:00100000:2.0:1782487587.801132:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066294422016:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.801142:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.801142:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+92:3315:x1869066299264384:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.801149:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 113 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801151:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 113 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.801157:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6157 count 1 00010000:00010000:1.0:1782487587.801170:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487587.801172:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6156 count 1 00010000:00010000:2.0:1782487587.801177:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 113 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801212:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.801214:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6324 00010000:00010000:2.0:1782487587.801217:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.801223:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.801225:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+87:2360:x1869066294422144:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.801239:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801239:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.801247:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801248:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801256:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.801268:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 78 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801274:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 87 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801281:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+113:2360:x1869066294422016:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.801284:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.801293:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.801298:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6323 00010000:00010000:1.0:1782487587.801300:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801302:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1807:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.801311:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1807:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.801316:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6325 00010000:00010000:0.0:1782487587.801318:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801326:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+112:2361:x1869066294422272:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.801332:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 78 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801333:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 112 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801336:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801341:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.801351:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 112 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.801362:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 78 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801367:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 106 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.801370:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.801376:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 112 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801394:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180c:0x0].0x0 since=5s v=(0 0) 00000100:00100000:1.0:1782487587.801397:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299264768:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.801398:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+87:2360:x1869066294422144:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 170us (410us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.801404:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.801408:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e353ab61/0x66475b4e8b854afa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4757b9 expref: 112 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801414:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.801417:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6324 00010000:00010000:2.0:1782487587.801432:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.801437:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.801440:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.801442:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801451:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 106 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801453:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.801467:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c24c991/0x66475b4e8b857c55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1807:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766ed expref: 86 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801479:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 106 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.801490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.801502:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299263872:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.801505:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299264896:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.801506:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.801520:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.801530:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801531:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+111:2361:x1869066294422272:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.801547:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6325 00010000:00010000:1.0:1782487587.801548:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.801558:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.801565:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801577:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422400 00000100:00100000:2.0:1782487587.801581:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422400 00010000:00010000:1.0:1782487587.801583:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.801599:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 110 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801601:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 86 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801647:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 110 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.801658:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6326 00000100:00100000:3.0:1782487587.801663:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299265024:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.801670:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2361:x1869066294422400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.801679:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.801684:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 86 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801696:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 86 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801710:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.801713:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1806:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.801718:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801726:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801741:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.801772:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2361:x1869066294422400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.801779:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6326 00000100:00100000:3.0:1782487587.801796:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9840 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.801813:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801823:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801833:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801841:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.801857:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1782487587.801915:0:213693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abe29e3a/0x66475b4e8b857c5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1806:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766f4 expref: 85 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.801934:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299264128:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.801934:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+93:3316:x1869066299262592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2503us (3086us total) trans 8589940106 rc 0/0 00000100:00100000:1.0:1782487587.801949:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16435 00010000:00010000:1.0:1782487587.801985:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.801991:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.801997:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802023:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.802024:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+87:3316:x1869066299262720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2215us (3038us total) trans 8589940764 rc 0/0 00010000:00010000:3.0:1782487587.802025:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802031:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802041:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16437 00010000:00010000:3.0:1782487587.802051:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802054:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.802071:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802078:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.802082:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.802088:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547685f80/2, rc 0, transno 8589940763 00010000:00010000:1.0:1782487587.802093:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85e82d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802102:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299261312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.802130:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.802133:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.802138:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802144:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.802148:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802157:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802165:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299264640:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.802172:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802182:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85e85e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1807:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802206:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.802211:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.802216:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802224:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.802228:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.802236:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87ca80/2, rc 0, transno 8589940764 00010000:00010000:1.0:1782487587.802237:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802246:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299262720:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.802254:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.802262:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87f100/2, rc 0, transno 8589940106 00010000:00010000:1.0:1782487587.802265:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802273:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299262592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.802286:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1782487587.802288:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.802294:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5434aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299264256:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.802295:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802306:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.802311:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802319:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.802339:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802345:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299265152:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.802353:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45cda86/0x66475b4e8b85e86c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1806:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802375:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.802379:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.802380:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.802386:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.802396:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.802404:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.802413:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.802441:0:190931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dfce631/0x66475b4e8b85502c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475956 expref: 110 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.802456:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299263744:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.802463:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299264640 00000100:00100000:2.0:1782487587.802467:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299264640 00010000:00010000:1.0:1782487587.802471:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802481:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802493:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802494:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299264256 00000100:00100000:2.0:1782487587.802498:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299264256 00010000:00010000:1.0:1782487587.802507:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802515:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802518:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299265152 00000100:00100000:2.0:1782487587.802524:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299265152 00000100:00100000:0.0:1782487587.802528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.802537:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.802553:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16440 00000100:00100000:0.0:1782487587.802557:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422528 00000100:00100000:3.0:1782487587.802558:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+94:3316:x1869066299263616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2792us (3643us total) trans 8589940107 rc 0/0 00000100:00100000:0.0:1782487587.802565:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422528 00000100:00100000:2.0:1782487587.802566:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+88:3316:x1869066299264640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.802573:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16436 00002000:00080000:2.0:1782487587.802584:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6162 count 1 00010000:00010000:0.0:1782487587.802591:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 79 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.802597:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16441 00010000:00010000:2.0:1782487587.802599:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.802638:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+93:3316:x1869066299264256:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.802640:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.802651:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1812:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.802654:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1812:0x0].0x0 since=0s v=(0 0) 00002000:00080000:3.0:1782487587.802656:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6156 count 1 00010000:00010000:2.0:1782487587.802659:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.802662:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6327 00010000:00010000:3.0:1782487587.802671:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.802679:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2360:x1869066294422528:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.802687:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.802690:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 79 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.802695:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.802705:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 79 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.802709:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.802711:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 109 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.802718:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+89:3315:x1869066299263488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3581us (4043us total) trans 8589940765 rc 0/0 00010000:00010000:3.0:1782487587.802719:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.802730:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.802738:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 79 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.802739:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16434 00000100:00100000:2.0:1782487587.802744:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299265536:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.802761:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16442 00010000:00010000:0.0:1782487587.802766:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.802772:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.802773:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5434a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+88:3316:x1869066299265152:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.802782:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802788:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d240 going to sleep for 11 seconds 00002000:00080000:1.0:1782487587.802790:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6165 count 1 00010000:00010000:0.0:1782487587.802794:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802806:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.802808:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 79 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.802811:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.802818:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299265408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.802836:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2360:x1869066294422528:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.802838:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 79 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802838:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.802856:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6327 00000100:00100000:2.0:1782487587.802859:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.802871:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.802879:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299265664:192.168.202.21@tcp:104: 00000004:00080000:2.0:1782487587.802889:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87dc00/2, rc 0, transno 8589940765 00010000:00010000:1.0:1782487587.802889:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1815:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.802897:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1815:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.802901:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299263488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.802904:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802911:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487587.802918:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299265280:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.802930:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.802942:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.802948:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.802961:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299265792:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.802984:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299265408 00000100:00100000:2.0:1782487587.802988:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299265408 00000100:00100000:2.0:1782487587.803009:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299265280 00000100:00100000:2.0:1782487587.803012:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299265280 00010000:00010000:1.0:1782487587.803016:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803030:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803036:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16443 00000100:00100000:2.0:1782487587.803047:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+89:3315:x1869066299265408:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.803050:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299265920:192.168.202.21@tcp:104: 00002000:00080000:2.0:1782487587.803061:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6159 count 1 00010000:00010000:2.0:1782487587.803076:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803086:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.803097:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803105:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180f:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782487587.803109:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.803113:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803128:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16444 00010000:00010000:2.0:1782487587.803134:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803144:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+94:3315:x1869066299265280:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.803149:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 109 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.803162:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6153 count 1 00000100:00100000:2.0:1782487587.803163:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299266048:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.803181:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803207:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803214:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1809:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.803217:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.803221:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803241:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803250:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803262:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299266176:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.803269:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.803293:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.803325:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299266304:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.803326:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.803334:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.803335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.803346:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.803351:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803361:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.803372:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803387:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.803396:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87c700/2, rc 0, transno 8589940107 00010000:00010000:1.0:1782487587.803396:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85e857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803406:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299263616:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.803421:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.803424:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.803427:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.803440:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299266304 00000100:00100000:1.0:1782487587.803445:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299266304 00000100:00100000:2.0:1782487587.803454:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782487587.803457:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9480 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.803463:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299266432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.803483:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16445 00000100:00100000:2.0:1782487587.803496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.803496:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:3316:x1869066299266304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.803513:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6160 count 1 00010000:00010000:1.0:1782487587.803526:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803535:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299266432 00000100:00100000:2.0:1782487587.803540:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299266432 00010000:00010000:1.0:1782487587.803541:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803551:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1810:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.803555:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.803560:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803572:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16446 00000100:00100000:2.0:1782487587.803583:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+95:3316:x1869066299266432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.803588:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 109 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.803597:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6154 count 1 00010000:00010000:1.0:1782487587.803603:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 109 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803668:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299266560:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.803724:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803729:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.803740:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803748:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.803752:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.803755:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803775:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803787:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803799:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299266688:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.803828:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6086d5f/0x66475b4e8b858110 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476828 expref: 78 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.803842:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299264768:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.803845:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.803859:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803868:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422656 00010000:00010000:1.0:1782487587.803869:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803872:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422656 00010000:00010000:1.0:1782487587.803882:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803892:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803895:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.803910:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.803929:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6328 00010000:00010000:1.0:1782487587.803929:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.803940:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2360:x1869066294422656:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.803948:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.803954:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803967:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 107 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.803982:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.804014:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+107:2360:x1869066294422656:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 75us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.804021:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6328 00000100:00100000:1.0:1782487587.804114:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+96:3315:x1869066299264384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2974us (3191us total) trans 8589940108 rc 0/0 00000100:00100000:1.0:1782487587.804123:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16439 00000004:00080000:2.0:1782487587.804135:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434a8700/2, rc 0, transno 8589940108 00000100:00100000:2.0:1782487587.804147:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299264384:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.804148:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.804157:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804165:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.804170:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804179:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804203:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804211:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85e873 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804226:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299265536:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.804230:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.804234:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.804239:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.804246:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804271:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299266816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.804300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.804310:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056731a0f/0x66475b4e8b85788f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1803:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47655e expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.804322:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558775f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299261568:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.804335:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299266816 00000100:00100000:2.0:1782487587.804340:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299266816 00010000:00010000:3.0:1782487587.804341:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.804353:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.804361:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804368:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16447 00000100:00100000:2.0:1782487587.804377:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3314:x1869066299266816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.804388:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6152 count 1 00010000:00010000:2.0:1782487587.804401:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804413:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 83 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804421:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1808:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.804425:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.804429:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.804445:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804451:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 83 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.804454:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.804474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.804478:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 83 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.804485:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.804490:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.804491:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299266944:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.804499:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804509:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.804514:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804522:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804529:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be840 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.804536:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.804545:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e826 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1803:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804555:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422912 00000100:00100000:2.0:1782487587.804559:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422912 00010000:00010000:1.0:1782487587.804566:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.804570:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.804574:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.804580:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 110 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.804601:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299265792:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.804633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.804639:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6329 00000100:00100000:2.0:1782487587.804650:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+110:2360:x1869066294422912:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.804658:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.804663:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 110 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804675:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 110 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804692:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb2eb1e/0x66475b4e8b8556ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b32 expref: 110 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804704:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.804708:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.804713:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804723:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.804728:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+97:3317:x1869066299260672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11269us (11439us total) trans 8589940109 rc 0/0 00000100:00100000:3.0:1782487587.804737:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16427 00010000:00010000:2.0:1782487587.804747:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.804764:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294422784 00000100:00100000:3.0:1782487587.804768:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294422784 00000100:00100000:2.0:1782487587.804780:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+110:2360:x1869066294422912:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 131us (313us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.804785:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 110 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.804792:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6329 00000100:00100000:2.0:1782487587.804823:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6330 00000100:00100000:2.0:1782487587.804833:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2360:x1869066294422784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.804842:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.804848:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 109 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804862:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 109 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804875:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.804878:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.804883:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.804892:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.804894:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87ed80/2, rc 0, transno 8589940103 00010000:00010000:2.0:1782487587.804911:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.804914:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299261952:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1782487587.804936:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547687800/2, rc 0, transno 8589940109 00000100:00100000:3.0:1782487587.804944:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.804945:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2360:x1869066294422784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.804958:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6330 00000004:00080000:3.0:1782487587.804969:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547685500/2, rc 0, transno 8589940759 00000100:00100000:3.0:1782487587.804982:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260800:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1782487587.804998:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d7a300/2, rc 0, transno 8589940762 00000100:00100000:3.0:1782487587.805003:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299260032:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1782487587.805016:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d79c00/2, rc 0, transno 8589940101 00000100:00100000:3.0:1782487587.805022:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299259776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.805064:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782487587.805077:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299267328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.805080:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805090:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805106:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.805114:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.805122:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805139:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.805144:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299267328 00000100:00100000:3.0:1782487587.805149:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299267200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.805150:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299267328 00000100:00100000:1.0:1782487587.805197:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16448 00000100:00100000:3.0:1782487587.805202:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.805211:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+97:3317:x1869066299267328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.805226:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6160 count 1 00010000:00010000:1.0:1782487587.805240:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805250:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805255:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1810:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.805257:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.805261:0:213221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7636f32/0x66475b4e8b854f37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475910 expref: 106 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805262:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.805290:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299262976:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.805295:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805304:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805307:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.805316:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299267712:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.805317:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805328:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805337:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805345:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.805359:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+91:3316:x1869066299264640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2795us (3153us total) trans 8589940766 rc 0/0 00010000:00010000:3.0:1782487587.805362:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.805363:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.805369:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16440 00000100:00100000:1.0:1782487587.805385:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299267200 00000100:00100000:1.0:1782487587.805391:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299267200 00000100:00100000:2.0:1782487587.805410:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.805428:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16449 00000100:00100000:1.0:1782487587.805438:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+98:3317:x1869066299267200:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.805446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1782487587.805449:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6158 count 1 00010000:00010000:1.0:1782487587.805460:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805469:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 77 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.805473:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:1.0:1782487587.805477:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.805482:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.805483:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.805492:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.805519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.805524:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 77 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805534:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 77 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.805544:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299267840:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.805547:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.805580:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.805590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.805603:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+91:3317:x1869066299262208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9140us (9269us total) trans 8589940767 rc 0/0 00000100:00100000:1.0:1782487587.805603:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299267456 00000100:00100000:3.0:1782487587.805649:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16430 00000100:00100000:2.0:1782487587.805654:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299267072 00000100:00100000:2.0:1782487587.805659:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299267072 00000100:00100000:3.0:1782487587.805674:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299267584 00000100:00100000:3.0:1782487587.805679:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299267584 00000100:00100000:2.0:1782487587.805693:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16450 00000100:00100000:1.0:1782487587.805700:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299267456 00000100:00100000:2.0:1782487587.805704:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+99:3314:x1869066299267072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.805714:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16451 00002000:00080000:2.0:1782487587.805718:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6155 count 1 00000100:00100000:3.0:1782487587.805725:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3314:x1869066299267584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.805733:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.805734:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16452 00002000:00080000:3.0:1782487587.805740:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6163 count 1 00000100:00100000:1.0:1782487587.805748:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3314:x1869066299267456:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.805756:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805765:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 83 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.805767:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6161 count 1 00010000:00010000:3.0:1782487587.805770:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 108 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805781:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805787:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.805796:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.805803:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805808:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 108 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805821:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1811:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782487587.805825:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1811:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.805829:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805832:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 83 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.805854:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 83 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.805868:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299267968:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.805869:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 108 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805885:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 108 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805896:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 105 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.805901:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299268096:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.805906:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d240 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.805907:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1813:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.805912:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.805916:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805934:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 105 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.805940:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.805943:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 105 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.805954:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299268224:192.168.202.21@tcp:104: 00000004:00080000:2.0:1782487587.805955:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434ab100/2, rc 0, transno 8589940766 00010000:00010000:1.0:1782487587.805960:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782487587.805968:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299264640:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.805969:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.805969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.805982:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.805986:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.805995:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 108 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.805998:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.806015:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423040 00000100:00100000:2.0:1782487587.806021:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423040 00010000:00010000:2.0:1782487587.806040:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.806041:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 108 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806045:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.806052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.806072:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.806076:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299268352:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.806077:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423168 00000100:00100000:2.0:1782487587.806083:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423168 00010000:00010000:1.0:1782487587.806099:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.806100:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806105:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.806113:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9c00 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.806122:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.806128:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.806129:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6331 00000100:00100000:2.0:1782487587.806141:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+106:2360:x1869066294423040:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.806141:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.806145:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6332 00010000:00010000:2.0:1782487587.806156:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.806165:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+109:2360:x1869066294423168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.806165:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806166:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.806185:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.806201:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85e83b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.806208:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806208:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806223:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.806226:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.806230:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.806239:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.806242:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806262:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b476227/0x66475b4e8b855a43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475c43 expref: 106 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.806268:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299265920:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.806467:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.806471:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fec8a9f6/0x66475b4e8b8557f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1815:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ba9 expref: 109 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806472:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.806480:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806492:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806504:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806508:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.806518:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.806527:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.806527:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806539:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.806541:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2360:x1869066294423040:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 402us (576us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.806557:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.806558:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+108:2360:x1869066294423168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 398us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.806558:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6331 00010000:00010000:1.0:1782487587.806585:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.806595:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299266048:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.806654:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.806655:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6332 00000100:00100000:2.0:1782487587.806695:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299268480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.806728:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.806771:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299268480 00000100:00100000:2.0:1782487587.806774:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299268480 00000100:00100000:2.0:1782487587.806803:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16453 00000100:00100000:2.0:1782487587.806815:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+94:3316:x1869066299268480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.806816:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5434a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3316:x1869066299265152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4042us (4435us total) trans 8589940768 rc 0/0 00000100:00100000:1.0:1782487587.806828:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16442 00002000:00080000:2.0:1782487587.806831:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6164 count 1 00010000:00010000:2.0:1782487587.806844:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806852:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.806857:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 107 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806860:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806874:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 104 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806877:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.806885:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806886:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1814:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.806894:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.806902:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806904:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806935:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806944:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 104 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806948:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85e88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.806963:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 104 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.806975:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.806976:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299268608:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.806980:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.806985:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.807039:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 107 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807051:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299266176:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.807052:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 107 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.807063:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87ea00/2, rc 0, transno 8589940767 00000100:00100000:2.0:1782487587.807069:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb559179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299268736:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.807072:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.807078:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299262208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.807096:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.807150:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb49058ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299268864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.807171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.807184:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.807234:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af8a8d92/0x66475b4e8b8558d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475be8 expref: 104 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.807240:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423296 00000100:00100000:2.0:1782487587.807245:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423296 00000100:00100000:1.0:1782487587.807249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.807266:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 108 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807290:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299266560:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.807292:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423552 00000100:00100000:2.0:1782487587.807297:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423552 00010000:00010000:1.0:1782487587.807310:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807312:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.807351:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6333 00000100:00100000:3.0:1782487587.807359:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299264896:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.807360:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+108:2360:x1869066294423296:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1782487587.807363:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547710a80/2, rc 0, transno 8589940768 00010000:00010000:2.0:1782487587.807376:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.807377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.807382:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299265152:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.807384:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 108 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.807387:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e97692/0x66475b4e8b855033 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47596b expref: 108 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.807413:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299265024:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.807414:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 107 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807435:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e6c5e6d/0x66475b4e8b8556b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b47 expref: 107 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.807436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.807439:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807443:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299268992:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.807461:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.807462:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807467:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.807476:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807486:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.807489:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807509:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.807513:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.807524:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807531:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299268864 00010000:00010000:3.0:1782487587.807532:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807537:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299268864 00000100:00100000:2.0:1782487587.807543:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2360:x1869066294423296:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 182us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.807551:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6333 00010000:00010000:3.0:1782487587.807555:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.807567:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423424 00000100:00100000:1.0:1782487587.807570:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299268992 00000100:00100000:2.0:1782487587.807572:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423424 00000100:00100000:1.0:1782487587.807575:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299268992 00010000:00010000:2.0:1782487587.807589:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.807631:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16454 00000100:00100000:2.0:1782487587.807635:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423680 00000100:00100000:2.0:1782487587.807640:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423680 00000100:00100000:1.0:1782487587.807644:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3317:x1869066299268864:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.807655:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.807659:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6167 count 1 00010000:00010000:1.0:1782487587.807678:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.807680:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6334 00000100:00100000:2.0:1782487587.807692:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2360:x1869066294423552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.807697:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 106 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807702:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.807710:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807710:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1817:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.807720:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.807729:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807733:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807757:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.807761:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.807765:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 106 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807767:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807787:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807794:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 106 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807806:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.807818:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299269120:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.807840:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5600db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2360:x1869066294423552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 149us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.807848:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6334 00000100:00100000:2.0:1782487587.807872:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6335 00000100:00100000:1.0:1782487587.807873:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.807884:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2360:x1869066294423424:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.807894:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.807899:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807910:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.807912:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807918:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807930:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.807933:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000703571be/0x66475b4e8b85828a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1809:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476898 expref: 84 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.807936:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807955:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1809:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.807955:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807961:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1809:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.807964:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:3315:x1869066299264512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6861us (7126us total) trans 8589940769 rc 0/0 00010000:00010000:2.0:1782487587.807972:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.807985:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16438 00010000:00010000:1.0:1782487587.807987:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.807988:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.808010:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16455 00010000:00010000:1.0:1782487587.808014:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177da8eb/0x66475b4e8b85e87a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.808027:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3314:x1869066299268992:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.808044:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1782487587.808046:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6168 count 1 00010000:00010000:1.0:1782487587.808051:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808056:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808060:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.808063:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.808078:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 106 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808079:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+83:2360:x1869066294423424:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 197us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.808095:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6335 00010000:00010000:3.0:1782487587.808096:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1818:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.808101:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.808106:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808114:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6336 00000100:00100000:2.0:1782487587.808123:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+106:2360:x1869066294423680:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.808131:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 106 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808131:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.808140:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808152:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808165:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5dd47f5/0x66475b4e8b8556a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b2b expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808176:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.808180:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.808185:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808205:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808230:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.808257:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066294423680:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 136us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.808265:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6336 00010000:00010000:2.0:1782487587.808289:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808298:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808308:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808317:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808334:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.808339:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.808346:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808359:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb452642800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.808364:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808372:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808385:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808395:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85e89d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1809:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808418:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808422:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.808425:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 104 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808426:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.808441:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299269248:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.808481:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+100:3315:x1869066299265280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5342us (5535us total) trans 8589940110 rc 0/0 00000100:00100000:2.0:1782487587.808490:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16444 00010000:00010000:2.0:1782487587.808519:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808529:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808543:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808552:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.808565:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299267712:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.808566:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.808583:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.808588:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9f00 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.808599:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.808603:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808656:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.808661:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808671:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.808675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.808691:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808700:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.808714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.808719:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.808722:0:213693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36b0d18/0x66475b4e8b858084 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476813 expref: 77 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808724:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808730:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.808741:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+96:3315:x1869066299265408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5695us (5886us total) trans 8589940770 rc 0/0 00000100:00100000:3.0:1782487587.808745:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299265664:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.808754:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16443 00010000:00010000:3.0:1782487587.808767:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.808778:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.808786:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808790:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299266688:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.808803:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808811:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.808812:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808855:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb559179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299268736:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.808856:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.808865:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808873:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.808878:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423808 00010000:00010000:1.0:1782487587.808879:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808882:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423808 00010000:00010000:1.0:1782487587.808893:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.808901:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 83 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.808902:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782487587.808909:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808921:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d57c726/0x66475b4e8b85e888 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.808922:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424064 00000100:00100000:2.0:1782487587.808927:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424064 00000100:00100000:0.0:1782487587.808935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.808945:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 84 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.808949:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808954:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.808959:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.808969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.808976:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294423936 00000100:00100000:2.0:1782487587.808980:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294423936 00010000:00010000:2.0:1782487587.808995:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809011:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424192 00000100:00100000:2.0:1782487587.809014:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424192 00010000:00010000:2.0:1782487587.809028:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809047:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6337 00000100:00100000:2.0:1782487587.809056:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2360:x1869066294423808:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.809065:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.809066:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+100:3316:x1869066299264256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6457us (6743us total) trans 8589940111 rc 0/0 00010000:00010000:2.0:1782487587.809074:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.809076:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16441 00000004:00080000:1.0:1782487587.809082:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434aaa00/2, rc 0, transno 8589940111 00010000:00010000:2.0:1782487587.809097:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.809101:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299264256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.809110:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6338 00010000:00010000:2.0:1782487587.809121:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cae4c4/0x66475b4e8b858291 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768a6 expref: 84 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.809122:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2360:x1869066294424064:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.809139:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.809141:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.809146:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.809149:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 83 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809152:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.809165:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782487587.809174:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.809178:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 83 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.809180:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299269376:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.809218:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.809219:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.809222:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1808:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.809229:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.809235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.809244:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809254:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+83:2360:x1869066294423808:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 198us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.809262:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.809263:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6337 00000100:00100000:2.0:1782487587.809285:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6339 00000100:00100000:3.0:1782487587.809292:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+82:2360:x1869066294424064:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 173us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.809298:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2360:x1869066294423936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.809307:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6338 00010000:00010000:2.0:1782487587.809308:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.809316:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809328:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.809337:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6340 00010000:00010000:2.0:1782487587.809350:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002852cf78/0x66475b4e8b8556ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b63 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809361:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.809390:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+104:2360:x1869066294423936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 98us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.809397:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6339 00000100:00100000:3.0:1782487587.809420:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294424192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.809429:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.809449:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809459:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809468:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809477:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809495:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.809501:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.809508:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809517:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.809521:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809531:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809546:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809560:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85e8ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.809577:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809584:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.809589:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.809593:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.809595:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.809681:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e457fbea/0x66475b4e8b85867a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1810:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a3c expref: 77 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809691:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+100:3316:x1869066299266432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6108us (6195us total) trans 8589940112 rc 0/0 00010000:00010000:3.0:1782487587.809696:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1810:0x0].0x0 since=0s v=(0 0) 00000004:00080000:1.0:1782487587.809700:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e7480/2, rc 0, transno 8589940112 00000100:00100000:2.0:1782487587.809702:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16446 00010000:00010000:3.0:1782487587.809703:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1810:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.809711:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.809716:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299266432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.809721:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299269376 00010000:00010000:3.0:1782487587.809725:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809726:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299269376 00000100:00100000:2.0:1782487587.809758:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16456 00000100:00100000:2.0:1782487587.809767:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+100:3314:x1869066299269376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.809779:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6159 count 1 00010000:00010000:1.0:1782487587.809779:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809792:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809794:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809811:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.809815:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.809818:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 76 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809832:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.809849:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+76:2361:x1869066294424192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 499us (879us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.809855:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 76 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.809863:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.809866:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6340 00010000:00010000:2.0:1782487587.809869:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.809874:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.809878:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809900:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 75 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809912:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 75 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.809923:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299269632:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.809982:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 75 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.809994:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 75 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810005:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299269760:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.810027:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+101:3317:x1869066299267328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4820us (4918us total) trans 8589940113 rc 0/0 00000100:00100000:2.0:1782487587.810034:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.810035:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16448 00000100:00100000:2.0:1782487587.810070:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299267968:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.810077:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299267840:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.810092:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810093:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.810136:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299268096:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.810145:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810146:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299268608:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.810163:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299268224:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.810169:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.810171:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810176:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810184:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299268352:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.810205:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.810210:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810222:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810226:0:213220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4ace3d9/0x66475b4e8b858283 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1808:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47688a expref: 81 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810252:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299266944:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.810253:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.810262:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.810270:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810270:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e8b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810293:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810302:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810303:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.810307:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.810311:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810313:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.810320:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810328:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.810343:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299269120:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.810344:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.810345:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424448 00000100:00100000:3.0:1782487587.810351:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424448 00000100:00100000:0.0:1782487587.810355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810359:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.810372:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 104 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810374:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.810380:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810399:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.810405:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810412:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810419:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424704 00010000:00010000:1.0:1782487587.810422:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810425:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424704 00000100:00100000:0.0:1782487587.810429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.810433:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e8b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1808:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.810443:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 105 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810448:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.810452:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.810456:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.810464:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424960 00000100:00100000:3.0:1782487587.810468:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424960 00000100:00100000:1.0:1782487587.810481:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299269504:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.810487:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 104 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810504:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+101:3314:x1869066299266816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6126us (6202us total) trans 8589940114 rc 0/0 00000100:00100000:3.0:1782487587.810505:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424320 00000100:00100000:3.0:1782487587.810510:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424320 00000100:00100000:2.0:1782487587.810515:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16447 00000100:00100000:1.0:1782487587.810523:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.810529:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 81 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810536:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299269504 00000100:00100000:2.0:1782487587.810540:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299269504 00000100:00100000:3.0:1782487587.810551:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424576 00000100:00100000:3.0:1782487587.810556:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424576 00000100:00100000:2.0:1782487587.810573:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457 00000100:00100000:2.0:1782487587.810582:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+101:3316:x1869066299269504:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.810586:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549180e00/2, rc 0, transno 8589940114 00002000:00080000:2.0:1782487587.810594:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6161 count 1 00000100:00100000:1.0:1782487587.810600:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299266816:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.810626:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810639:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 76 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810647:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1811:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.810652:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1811:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.810656:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.810670:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 76 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810680:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 76 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.810690:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1782487587.810693:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 76 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810694:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294424832 00000100:00100000:3.0:1782487587.810700:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294424832 00000100:00100000:1.0:1782487587.810703:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299269888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.810721:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 105 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.810722:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299270016:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.810743:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.810775:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.810780:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299269888 00000100:00100000:1.0:1782487587.810786:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299269888 00000100:00100000:3.0:1782487587.810794:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425088 00010000:00010000:2.0:1782487587.810797:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810800:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425088 00010000:00010000:2.0:1782487587.810809:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.810820:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.810820:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458 00010000:00010000:3.0:1782487587.810825:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.810834:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+102:3316:x1869066299269888:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.810839:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.810850:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6163 count 1 00010000:00010000:2.0:1782487587.810858:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.810862:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810872:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 76 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810877:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1813:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.810880:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.810882:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810899:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 76 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810907:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 76 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.810919:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e5d54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299270144:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.810955:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.810967:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.810972:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.810978:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.810980:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425216 00010000:00010000:1.0:1782487587.810982:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.810985:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425216 00010000:00010000:1.0:1782487587.810993:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.810993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.811003:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 107 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811005:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811020:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007635a9d7/0x66475b4e8b85e8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1810:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.811024:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425344 00000100:00100000:2.0:1782487587.811027:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+96:3316:x1869066299266304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7533us (7666us total) trans 8589940771 rc 0/0 00000100:00100000:3.0:1782487587.811029:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425344 00000100:00100000:2.0:1782487587.811039:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16445 00010000:00010000:1.0:1782487587.811042:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.811044:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811046:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.811049:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.811065:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6341 00000100:00100000:2.0:1782487587.811073:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6342 00000100:00100000:3.0:1782487587.811078:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2361:x1869066294424448:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1782487587.811078:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e4e00/2, rc 0, transno 8589940771 00000100:00100000:0.0:1782487587.811079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.811089:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+107:2361:x1869066294424704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.811091:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.811091:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299266304:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.811102:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.811110:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 107 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811129:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 107 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.811136:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299270272:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.811148:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 107 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811149:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7d9dd9/0x66475b4e8b8556c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b55 expref: 107 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.811164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.811173:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811176:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.811200:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025de1c45/0x66475b4e8b8556bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475b4e expref: 106 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.811211:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1811:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.811214:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299270272 00010000:00010000:3.0:1782487587.811215:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1811:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.811219:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299270272 00010000:00010000:3.0:1782487587.811222:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.811226:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+105:2361:x1869066294424704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (1055us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.811241:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.811242:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16459 00000100:00100000:2.0:1782487587.811243:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6342 00000100:00100000:1.0:1782487587.811253:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+96:3314:x1869066299270272:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.811265:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425472 00002000:00080000:1.0:1782487587.811266:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6166 count 1 00000100:00100000:2.0:1782487587.811270:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425472 00010000:00010000:3.0:1782487587.811276:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.811277:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811290:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 78 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811290:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 104 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811313:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1816:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.811316:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.811319:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.811324:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6343 00000100:00100000:2.0:1782487587.811333:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+105:2361:x1869066294424960:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.811338:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 104 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811343:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.811346:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 104 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811352:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 105 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.811359:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299270400:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.811372:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 105 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.811386:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.811394:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7611739/0x66475b4e8b85617b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475e34 expref: 105 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811402:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.811405:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+104:2361:x1869066294424448:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 328us (1297us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.811409:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.811415:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811417:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1814:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.811425:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6341 00010000:00010000:2.0:1782487587.811428:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811434:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811442:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811444:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.811453:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6344 00010000:00010000:1.0:1782487587.811469:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.811473:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.811497:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+104:2361:x1869066294424960:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.811504:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6343 00000100:00100000:2.0:1782487587.811524:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6345 00000100:00100000:2.0:1782487587.811534:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2361:x1869066294424576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.811543:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.811549:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 78 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.811565:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+81:2361:x1869066294424320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.811565:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 78 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.811584:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.811592:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 81 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811595:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006660a767/0x66475b4e8b8585bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769e8 expref: 78 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811648:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.811651:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.811657:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811666:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811685:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.811717:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294424576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 186us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.811725:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+97:3314:x1869066299267456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5979us (6277us total) trans 8589940772 rc 0/0 00000100:00100000:2.0:1782487587.811730:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6345 00000100:00100000:1.0:1782487587.811740:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16452 00000100:00100000:2.0:1782487587.811754:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6346 00000100:00100000:2.0:1782487587.811763:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+103:2361:x1869066294424832:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.811767:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811771:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.811778:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811780:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 103 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811797:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811804:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 103 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811825:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811844:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d1e9cd/0x66475b4e8b856047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475de0 expref: 103 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.811846:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.811860:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.811864:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.811869:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811878:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811899:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.811930:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066294424832:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.811943:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6346 00010000:00010000:3.0:1782487587.811947:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 81 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.811959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.811967:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc20ca26/0x66475b4e8b85826e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476891 expref: 81 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.811968:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6347 00000100:00100000:2.0:1782487587.811980:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2361:x1869066294425088:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.811982:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.811987:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.811989:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.811993:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.811997:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 103 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812012:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.812013:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+103:3317:x1869066299267200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6572us (6822us total) trans 8589940115 rc 0/0 00010000:00010000:2.0:1782487587.812020:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 103 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.812034:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16449 00000100:00100000:0.0:1782487587.812039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.812057:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812060:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.812062:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.812066:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812068:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812082:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812087:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.812094:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812099:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.812101:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.812107:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812123:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812130:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6c234de/0x66475b4e8b85e8d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812132:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+103:2361:x1869066294425088:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 154us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.812149:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6347 00010000:00010000:1.0:1782487587.812162:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.812166:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812168:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425728 00000100:00100000:3.0:1782487587.812172:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+80:2361:x1869066294424320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 673us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.812174:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425728 00010000:00010000:1.0:1782487587.812179:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.812184:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.812201:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6344 00010000:00010000:1.0:1782487587.812203:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812204:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 77 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812228:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812234:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425600 00010000:00010000:1.0:1782487587.812234:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e8c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812239:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425600 00010000:00010000:1.0:1782487587.812254:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.812256:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 78 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812257:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.812262:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.812283:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6348 00000100:00100000:1.0:1782487587.812289:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e5d54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299270144:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.812295:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+102:2361:x1869066294425216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.812303:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.812306:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812311:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 102 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812325:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 102 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812325:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.812343:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006acfc768/0x66475b4e8b856326 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ece expref: 102 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.812353:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549164a80/2, rc 0, transno 8589940772 00010000:00010000:2.0:1782487587.812356:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812360:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812365:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.812366:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267456:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.812380:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812400:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.812417:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.812426:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6349 00000100:00100000:2.0:1782487587.812432:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2361:x1869066294425216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 138us (2005us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.812432:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.812432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.812445:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2360:x1869066294425344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.812452:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6348 00010000:00010000:1.0:1782487587.812453:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812460:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812461:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.812468:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425856 00010000:00010000:3.0:1782487587.812472:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 78 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812473:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425856 00010000:00010000:1.0:1782487587.812475:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.812490:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 78 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812493:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 101 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812524:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.812529:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6350 00000100:00100000:2.0:1782487587.812539:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2361:x1869066294425472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.812547:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.812553:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 78 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.812565:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2360:x1869066294425344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 125us (1574us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.812568:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 78 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812588:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812592:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x180f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812597:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812645:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.812653:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb49058f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+97:3317:x1869066299268864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5011us (5468us total) trans 8589940773 rc 0/0 00000100:00100000:3.0:1782487587.812655:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6349 00000100:00100000:1.0:1782487587.812665:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16454 00010000:00010000:2.0:1782487587.812668:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.812682:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6351 00010000:00010000:1.0:1782487587.812686:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.812691:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.812696:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294425728:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.812701:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.812703:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294425472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 164us (1629us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.812705:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812717:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6350 00010000:00010000:1.0:1782487587.812718:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812730:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.812736:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85e8e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812740:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6352 00000100:00100000:2.0:1782487587.812754:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+76:2360:x1869066294425600:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.812760:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.812763:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.812764:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.812770:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.812773:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 76 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812776:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.812780:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1782487587.812788:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 76 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.812791:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299270528:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.812809:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 76 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812813:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 76 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812833:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1811:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.812833:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.812839:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1811:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812844:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812852:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812866:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.812885:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299270400:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.812897:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812900:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+76:2360:x1869066294425600:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 148us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.812914:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6352 00000100:00100000:2.0:1782487587.812932:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6353 00010000:00010000:3.0:1782487587.812937:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dae631a/0x66475b4e8b858b58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1813:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bbd expref: 75 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.812945:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+101:2360:x1869066294425856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.812957:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.812958:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.812963:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1813:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.812965:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 101 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812969:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.812984:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.812986:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 101 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813015:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007481fa0c/0x66475b4e8b85646f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f3e expref: 101 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813026:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.813029:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.813035:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813043:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.813079:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.813079:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.813086:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813093:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813099:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813104:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.813113:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2360:x1869066294425856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.813123:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6353 00010000:00010000:1.0:1782487587.813125:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.813147:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.813158:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2361:x1869066294425728:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 422us (1159us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.813160:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.813176:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6351 00010000:00010000:2.0:1782487587.813176:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813198:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813214:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.813303:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4e5d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+103:3316:x1869066299269888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2473us (2562us total) trans 8589940116 rc 0/0 00000100:00100000:1.0:1782487587.813311:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458 00000100:00100000:1.0:1782487587.813330:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299270528 00000100:00100000:1.0:1782487587.813334:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299270528 00000100:00100000:1.0:1782487587.813364:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16460 00000100:00100000:1.0:1782487587.813374:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+97:3314:x1869066299270528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.813389:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6172 count 1 00010000:00010000:1.0:1782487587.813403:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.813408:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb546d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+103:3314:x1869066299267072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7705us (7887us total) trans 8589940117 rc 0/0 00000100:00100000:2.0:1782487587.813425:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16450 00010000:00010000:1.0:1782487587.813429:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 101 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813438:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.813442:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.813447:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813457:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813470:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813470:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 101 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813493:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813494:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 101 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813513:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.813539:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299270656:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.813540:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.813596:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.813623:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.813627:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813632:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.813636:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813643:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813653:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813659:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b16b92b/0x66475b4e8b85e8ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813679:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.813681:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813686:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.813690:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.813695:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549166300/2, rc 0, transno 8589940110 00010000:00010000:1.0:1782487587.813696:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813709:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813714:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85e8c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813729:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.813733:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+98:3316:x1869066299268480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6920us (7002us total) trans 8589940774 rc 0/0 00010000:00010000:1.0:1782487587.813734:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.813748:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299265280:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.813749:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.813752:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16453 00010000:00010000:1.0:1782487587.813755:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813762:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813772:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813776:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85e8dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.813777:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549167480/2, rc 0, transno 8589940770 00000100:00100000:3.0:1782487587.813793:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299265408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.813797:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.813798:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097153226/0x66475b4e8b8588e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b31 expref: 73 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813803:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.813809:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487587.813816:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5434aad80/2, rc 0, transno 8589940769 00000100:00100000:2.0:1782487587.813817:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299269632:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.813828:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5434aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299264512:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.813845:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f735401/0x66475b4e8b8588db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x180f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b2a expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.813860:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299269760:192.168.202.21@tcp:104: 00000004:00080000:3.0:1782487587.813879:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb49058ed80/2, rc 0, transno 8589940773 00010000:00010000:2.0:1782487587.813883:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.813891:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb49058ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299268864:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.813896:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813905:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.813913:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549182a00/2, rc 0, transno 8589940113 00010000:00010000:2.0:1782487587.813914:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.813925:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.813927:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299267328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.813950:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782487587.813951:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549180380/2, rc 0, transno 8589940115 00010000:00010000:1.0:1782487587.813959:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782487587.813963:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299267200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.813966:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813976:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.813978:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299270912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.813983:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.813994:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814009:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.814011:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.814022:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85e8f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x180f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.814034:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782487587.814042:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299270784:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.814043:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.814048:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.814053:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.814075:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.814082:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.814096:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299270912 00000100:00100000:1.0:1782487587.814099:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299270912 00000100:00100000:3.0:1782487587.814107:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299271296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.814127:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299270784 00000100:00100000:1.0:1782487587.814130:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299270784 00000100:00100000:2.0:1782487587.814136:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+103:3314:x1869066299269376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4369us (4904us total) trans 8589940118 rc 0/0 00000100:00100000:2.0:1782487587.814145:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16456 00000100:00100000:3.0:1782487587.814164:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.814169:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16461 00000100:00100000:1.0:1782487587.814176:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16462 00000100:00100000:2.0:1782487587.814181:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+99:3317:x1869066299270912:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.814200:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+99:3317:x1869066299270784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.814209:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6169 count 1 00002000:00080000:1.0:1782487587.814215:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6171 count 1 00010000:00010000:2.0:1782487587.814223:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814228:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814243:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 99 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814249:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814255:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1819:0x0].0x0 since=4s v=(0 0) 00000100:00100000:3.0:1782487587.814262:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299271424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.814264:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.814267:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.814271:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814273:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.814283:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.814295:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.814301:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 99 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814313:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814315:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 99 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.814344:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299271552:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.814344:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.814359:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299271680:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.814402:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.814402:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.814418:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.814425:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299271296 00000100:00100000:1.0:1782487587.814430:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299271296 00000100:00100000:2.0:1782487587.814434:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299271424 00000100:00100000:2.0:1782487587.814438:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299271424 00000100:00100000:1.0:1782487587.814464:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16463 00000100:00100000:2.0:1782487587.814472:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16464 00000100:00100000:1.0:1782487587.814477:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3317:x1869066299271296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.814485:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+104:3317:x1869066299271424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.814490:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6166 count 1 00002000:00080000:2.0:1782487587.814498:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6165 count 1 00010000:00010000:1.0:1782487587.814505:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814514:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814519:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 79 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814529:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1816:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.814531:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 79 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814533:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.814540:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814548:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1815:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.814553:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.814558:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814568:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 79 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.814579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.814584:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 79 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.814585:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 79 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814651:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 79 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.814665:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299271936:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.814689:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299271808:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.814710:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.814722:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.814727:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294425984 00000100:00100000:2.0:1782487587.814732:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294425984 00010000:00010000:2.0:1782487587.814749:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 102 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.814766:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299270656:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.814782:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6354 00010000:00010000:1.0:1782487587.814786:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.814793:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+102:2361:x1869066294425984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.814813:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.814820:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 102 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.814832:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4e5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299271040:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.814834:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 102 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814854:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007348a450/0x66475b4e8b8568d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760c6 expref: 102 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814868:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.814874:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.814875:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.814882:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814891:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814912:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1782487587.814913:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb56d87fb80/2, rc 0, transno 8589940118 00000100:00100000:1.0:1782487587.814927:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb56d87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299269376:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.814941:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549182d80/2, rc 0, transno 8589940117 00000100:00100000:2.0:1782487587.814944:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294425984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 153us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.814949:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.814956:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6354 00000100:00100000:1.0:1782487587.814963:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.814973:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299271168:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.814982:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.814992:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815001:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.815003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.815014:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815030:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.815095:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299271040 00000100:00100000:1.0:1782487587.815100:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299271040 00000100:00100000:1.0:1782487587.815132:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299271168 00000100:00100000:1.0:1782487587.815136:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299271168 00000100:00100000:1.0:1782487587.815176:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465 00000100:00100000:2.0:1782487587.815210:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+101:3314:x1869066299270528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1837us (2378us total) trans 8589940775 rc 0/0 00000100:00100000:2.0:1782487587.815218:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16460 00000100:00100000:2.0:1782487587.815237:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16466 00000100:00100000:2.0:1782487587.815245:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+100:3314:x1869066299271168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.815257:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6170 count 1 00010000:00010000:2.0:1782487587.815268:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815281:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815289:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.815293:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.815297:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815315:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815327:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.815340:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299272320:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.815374:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126f00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.815388:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.815393:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815401:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.815406:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815415:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815429:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815438:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb66868/0x66475b4e8b85e90d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815457:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.815459:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.815463:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.815502:0:213220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033181aa0/0x66475b4e8b8588aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1811:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b23 expref: 71 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.815514:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299270016:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.815529:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815539:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815547:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815556:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815564:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815579:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.815725:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+105:3314:x1869066299271040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.815743:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6162 count 1 00010000:00010000:1.0:1782487587.815758:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.815771:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56d87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+106:3316:x1869066299269504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5189us (5250us total) trans 8589940119 rc 0/0 00010000:00010000:1.0:1782487587.815774:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 70 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.815784:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457 00010000:00010000:1.0:1782487587.815787:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1812:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.815791:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.815797:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.815808:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.815821:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.815822:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 70 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.815844:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.815849:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 70 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.815861:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.815873:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299272448:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.815883:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.815891:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.815898:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815906:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.815911:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815920:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.815929:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.815934:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815943:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e8f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1811:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.815965:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.815967:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.815972:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.815972:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.815978:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.815984:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.815990:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.816000:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.816007:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299271552:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.816016:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816024:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.816026:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cda0b16/0x66475b4e8b85e8ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1813:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.816058:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.816062:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.816065:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.816093:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299271680:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.816111:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816144:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299272064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.816175:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.816219:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299272064 00000004:00080000:1.0:1782487587.816222:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44a0e6680/2, rc 0, transno 8589940775 00000100:00100000:2.0:1782487587.816224:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299272064 00000100:00100000:1.0:1782487587.816237:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299270528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.816256:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.816261:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16467 00000100:00100000:1.0:1782487587.816266:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299272192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.816272:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+106:3314:x1869066299272064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.816287:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6164 count 1 00010000:00010000:2.0:1782487587.816301:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816310:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.816319:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816328:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1814:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.816333:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.816337:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816359:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.816369:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+101:3314:x1869066299267584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10646us (10779us total) trans 8589940776 rc 0/0 00010000:00010000:2.0:1782487587.816372:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.816390:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299272576:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.816398:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299272192 00000100:00100000:1.0:1782487587.816403:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299272192 00000100:00100000:2.0:1782487587.816429:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.816434:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16451 00000100:00100000:3.0:1782487587.816457:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16468 00000100:00100000:0.0:1782487587.816462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.816469:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+107:3314:x1869066299272192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487587.816480:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6167 count 1 00010000:00010000:3.0:1782487587.816492:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.816504:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 79 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.816508:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb560a04a80/2, rc 0, transno 8589940776 00010000:00010000:3.0:1782487587.816516:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1817:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.816520:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1817:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.816523:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb560a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299267584:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.816536:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.816546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.816567:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 79 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816567:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299272704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.816582:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426240 00010000:00010000:3.0:1782487587.816584:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 79 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.816587:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426240 00000100:00100000:3.0:1782487587.816600:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299272960:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.816649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.816662:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816689:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.816691:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426112 00000100:00100000:3.0:1782487587.816693:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9780 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.816696:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426112 00010000:00010000:2.0:1782487587.816712:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 100 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.816721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.816722:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426368 00000004:00080000:1.0:1782487587.816727:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54765ce00/2, rc 0, transno 8589940116 00000100:00100000:3.0:1782487587.816729:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426368 00000100:00100000:1.0:1782487587.816743:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54765ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299269888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.816749:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426496 00010000:00010000:3.0:1782487587.816753:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 80 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.816754:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426496 00000004:00080000:1.0:1782487587.816760:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb45a53f100/2, rc 0, transno 8589940119 00000100:00100000:1.0:1782487587.816770:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb45a53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299269504:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.816772:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 81 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.816793:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb543520700/2, rc 0, transno 8589940774 00000100:00100000:3.0:1782487587.816795:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6355 00000100:00100000:1.0:1782487587.816808:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299268480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.816809:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6356 00000100:00100000:3.0:1782487587.816813:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+101:2361:x1869066294426240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.816825:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+100:2360:x1869066294426112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.816828:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.816828:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1782487587.816835:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.816839:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816840:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299272832:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.816845:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 100 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.816870:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816873:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 100 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816884:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.816906:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b8568e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4760cd expref: 101 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816907:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f53adf/0x66475b4e8b856484 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475f53 expref: 100 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816937:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.816940:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.816941:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.816944:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.816948:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.816949:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.816971:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.816977:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.816998:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299271808:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.817009:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.817015:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.817017:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.817037:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066294426240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 231us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.817045:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2360:x1869066294426112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (501us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.817045:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.817046:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6355 00010000:00010000:1.0:1782487587.817063:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.817064:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6356 00000100:00100000:3.0:1782487587.817076:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6357 00010000:00010000:1.0:1782487587.817078:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.817089:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+81:2360:x1869066294426368:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.817089:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.817092:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6358 00000100:00100000:2.0:1782487587.817106:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+81:2360:x1869066294426496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.817107:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.817113:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.817118:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 81 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817119:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.817128:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 81 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.817138:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 81 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817146:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 81 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.817154:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af94793/0x66475b4e8b858f02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1816:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cd5 expref: 81 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817164:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.817168:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.817170:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1815:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.817179:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1816:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.817180:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.817199:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817215:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817241:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.817260:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+80:2360:x1869066294426496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.817270:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+101:3317:x1869066299270784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3084us (3198us total) trans 8589940777 rc 0/0 00000100:00100000:2.0:1782487587.817272:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6358 00000100:00100000:1.0:1782487587.817283:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16462 00010000:00010000:2.0:1782487587.817290:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.817296:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817296:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299272704 00000100:00100000:1.0:1782487587.817300:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299272704 00010000:00010000:2.0:1782487587.817308:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8de00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.817313:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817318:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299272832 00010000:00010000:2.0:1782487587.817322:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817322:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299272832 00010000:00010000:2.0:1782487587.817338:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817347:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075946bf0/0x66475b4e8b85e91b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817347:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469 00000100:00100000:1.0:1782487587.817360:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+102:3316:x1869066299272704:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.817364:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.817367:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.817369:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782487587.817374:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6175 count 1 00000100:00100000:2.0:1782487587.817384:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470 00010000:00010000:1.0:1782487587.817389:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.817395:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+102:3316:x1869066299272832:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.817400:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817413:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 99 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.817414:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6173 count 1 00010000:00010000:1.0:1782487587.817425:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.817429:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.817430:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.817430:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817435:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.817446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.817465:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817473:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.817476:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 99 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817477:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.817486:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817499:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 99 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.817500:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+79:2360:x1869066294426368:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 414us (850us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.817513:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817524:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299273472:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.817527:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6357 00010000:00010000:2.0:1782487587.817530:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.817545:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299273600:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.817563:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.817564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.817576:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.817584:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817594:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817603:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.817633:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426624 00000100:00100000:2.0:1782487587.817635:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299272320:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.817638:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426624 00010000:00010000:1.0:1782487587.817639:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817655:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.817658:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.817675:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.817680:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817694:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a480600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.817698:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817706:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817720:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817728:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c2f17de/0x66475b4e8b85e922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817751:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.817754:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.817758:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.817796:0:190930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5e9e458/0x66475b4e8b858f25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1815:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cdc expref: 78 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.817809:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299271936:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.817825:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817835:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.817838:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817843:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+108:3317:x1869066299271296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3368us (3678us total) trans 8589940120 rc 0/0 00010000:00010000:2.0:1782487587.817857:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.817864:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16463 00010000:00010000:2.0:1782487587.817874:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817882:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.817897:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.817901:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299273216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.817939:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.817957:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426752 00000100:00100000:3.0:1782487587.817962:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426752 00000100:00100000:1.0:1782487587.817972:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.817982:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299273088:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.817985:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.818011:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6359 00000100:00100000:1.0:1782487587.818031:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.818071:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299273216 00000100:00100000:2.0:1782487587.818074:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+108:3317:x1869066299271424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3592us (3780us total) trans 8589940121 rc 0/0 00000100:00100000:1.0:1782487587.818077:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299273216 00000100:00100000:2.0:1782487587.818085:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16464 00000100:00100000:3.0:1782487587.818096:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+99:2360:x1869066294426624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.818102:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299273088 00000100:00100000:2.0:1782487587.818107:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299273088 00010000:00010000:3.0:1782487587.818109:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.818110:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16471 00010000:00010000:3.0:1782487587.818118:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818124:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+108:3315:x1869066299273216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.818135:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16472 00002000:00080000:1.0:1782487587.818140:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6168 count 1 00000100:00100000:2.0:1782487587.818146:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+103:3315:x1869066299273088:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.818157:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.818161:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6174 count 1 00010000:00010000:1.0:1782487587.818174:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818176:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818201:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1818:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.818207:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.818209:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 99 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818214:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.818227:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.818235:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.818239:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818243:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.818250:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818262:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818273:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 99 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818277:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818294:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 99 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818300:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299273728:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.818313:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299273856:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.818355:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.818356:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.818375:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.818381:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818389:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.818394:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818398:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299272448:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.818408:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818422:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818424:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818450:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85e929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1815:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818468:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.818471:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.818475:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.818476:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb546c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299273344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.818500:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299272576:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.818514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.818516:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.818540:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294426880 00000100:00100000:2.0:1782487587.818543:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294426880 00000100:00100000:0.0:1782487587.818548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.818559:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 78 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818561:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299273344 00000100:00100000:1.0:1782487587.818568:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299273344 00000100:00100000:2.0:1782487587.818578:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427008 00000100:00100000:2.0:1782487587.818584:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427008 00010000:00010000:2.0:1782487587.818600:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 79 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.818624:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9e987e/0x66475b4e8b856771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476033 expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818628:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473 00000100:00100000:1.0:1782487587.818644:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+109:3316:x1869066299273344:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.818652:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6360 00002000:00080000:1.0:1782487587.818659:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6170 count 1 00000100:00100000:2.0:1782487587.818663:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+71:2361:x1869066294426752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.818674:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.818676:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818681:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818701:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 79 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818711:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818712:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.818721:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.818730:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818737:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df39f171/0x66475b4e8b858b5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1812:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bcb expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818752:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.818756:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1812:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.818759:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 79 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818762:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818784:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818787:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 79 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.818795:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.818806:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.818813:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.818814:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299273984:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.818819:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.818830:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.818853:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+70:2361:x1869066294426752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 193us (1290us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.818856:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.818863:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6360 00000100:00100000:1.0:1782487587.818864:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.818887:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6361 00000100:00100000:3.0:1782487587.818890:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2360:x1869066294426624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 868us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.818899:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299273472:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.818900:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+79:2361:x1869066294426880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.818914:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.818920:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.818922:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818953:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.818968:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c678b2ce/0x66475b4e8b858fcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1814:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf1 expref: 79 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.818980:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df6680/2, rc 0, transno 8589940121 00010000:00010000:2.0:1782487587.818981:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.818988:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1814:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.818992:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.818995:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6359 00000100:00100000:1.0:1782487587.818997:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299271424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.819010:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.819020:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44a0e6300/2, rc 0, transno 8589940777 00000100:00100000:0.0:1782487587.819023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.819026:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.819034:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299270784:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.819050:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df6a00/2, rc 0, transno 8589940120 00000100:00100000:1.0:1782487587.819058:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299271296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.819059:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2361:x1869066294426880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.819071:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6361 00000100:00100000:2.0:1782487587.819085:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427264 00000100:00100000:2.0:1782487587.819088:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427264 00010000:00010000:2.0:1782487587.819102:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.819120:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6362 00000100:00100000:2.0:1782487587.819129:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2361:x1869066294427008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.819138:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.819143:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 77 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819155:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 77 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819166:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299274240:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.819169:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.819174:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1817:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.819179:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819199:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.819207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.819217:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6363 00010000:00010000:2.0:1782487587.819218:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.819315:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294427264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.819327:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.819333:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819345:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819364:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.819367:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.819371:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819379:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819393:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.819525:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2361:x1869066294427008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 397us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.819535:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6362 00000100:00100000:1.0:1782487587.819541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.819551:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427136 00000100:00100000:2.0:1782487587.819555:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427136 00010000:00010000:2.0:1782487587.819569:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 100 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819573:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.819585:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299274368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.819591:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294427264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 301us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.819591:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6364 00000100:00100000:2.0:1782487587.819602:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+100:2361:x1869066294427136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.819621:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6363 00010000:00010000:2.0:1782487587.819641:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.819642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.819650:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 100 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819665:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 100 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819680:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091bf9f56/0x66475b4e8b856b92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47616e expref: 100 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819681:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299274240 00000100:00100000:1.0:1782487587.819688:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299274240 00000100:00100000:0.0:1782487587.819691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.819704:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.819708:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.819712:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819717:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299274368 00000100:00100000:1.0:1782487587.819723:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299274368 00010000:00010000:2.0:1782487587.819724:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.819737:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427392 00000100:00100000:3.0:1782487587.819742:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427392 00010000:00010000:2.0:1782487587.819751:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.819752:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16474 00010000:00010000:3.0:1782487587.819759:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819762:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+111:3314:x1869066299274240:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.819771:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16475 00002000:00080000:1.0:1782487587.819775:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6169 count 1 00000100:00100000:3.0:1782487587.819785:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6365 00000100:00100000:2.0:1782487587.819785:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+111:3314:x1869066299274368:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.819789:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.819801:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6172 count 1 00010000:00010000:1.0:1782487587.819803:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 77 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819817:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.819819:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1819:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.819829:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.819837:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819840:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 77 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819859:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.819864:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.819865:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2360:x1869066294427392:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.819869:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.819871:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 77 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819875:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.819882:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.819892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.819896:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819901:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.819904:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 77 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819912:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299274496:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.819923:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.819929:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 77 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.819930:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1818:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.819940:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.819947:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299274624:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.819954:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.819963:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.819971:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.819983:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591263c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.819997:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8ca0915/0x66475b4e8b85903d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d14 expref: 77 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820011:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294427136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 410us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.820014:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299273728:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.820024:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6364 00010000:00010000:1.0:1782487587.820033:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820043:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427520 00010000:00010000:1.0:1782487587.820044:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820047:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427520 00010000:00010000:1.0:1782487587.820061:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820063:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 98 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820085:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820095:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820096:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6366 00000100:00100000:2.0:1782487587.820108:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294427520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.820114:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.820119:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.820126:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 98 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820140:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 98 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.820143:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:2360:x1869066294427392:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 185us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.820159:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6365 00010000:00010000:2.0:1782487587.820160:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.820165:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.820170:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820178:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820205:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.820222:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed30383f/0x66475b4e8b8575b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1800:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a1 expref: 69 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.820238:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558774e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299261056:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.820238:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2361:x1869066294427520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 130us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.820252:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6366 00010000:00010000:3.0:1782487587.820262:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.820271:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.820279:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820297:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e75aaf4/0x66475b4e8b856d83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761d7 expref: 97 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820311:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299273600:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.820314:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb46eabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+112:3315:x1869066299273216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2191us (2373us total) trans 8589940122 rc 0/0 00000100:00100000:1.0:1782487587.820324:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16471 00010000:00010000:2.0:1782487587.820328:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820344:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820346:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.820355:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820357:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820379:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.820381:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820386:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820392:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820402:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.820419:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.820426:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.820428:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820428:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.820441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.820442:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a93f4948/0x66475b4e8b85e95a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.820449:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.820463:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.820467:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820475:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.820479:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820487:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820500:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820508:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820527:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.820531:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820538:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.820543:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820552:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820564:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820572:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e811 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1800:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.820593:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.820596:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.820600:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.820642:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299273984:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.820653:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+104:3316:x1869066299272832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3259us (3773us total) trans 8589940778 rc 0/0 00010000:00010000:1.0:1782487587.820660:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.820664:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470 00010000:00010000:2.0:1782487587.820691:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.820699:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.820714:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.820715:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c38700/2, rc 0, transno 8589940122 00010000:00010000:2.0:1782487587.820728:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.820730:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299273216:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.820745:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.820752:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb547684000/2, rc 0, transno 8589940123 00010000:00010000:2.0:1782487587.820755:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.820760:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb547684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299260544:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.820773:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.820827:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.820831:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb547686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+112:3315:x1869066299260544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27791us (27892us total) trans 8589940123 rc 0/0 00000100:00100000:3.0:1782487587.820839:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16424 00000100:00100000:1.0:1782487587.820863:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.820898:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb453dd0380/2, rc 0, transno 8589940778 00000100:00100000:0.0:1782487587.820908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.820909:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299272832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.820921:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782487587.820928:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.820959:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.820963:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+104:3314:x1869066299271168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5716us (5958us total) trans 8589940779 rc 0/0 00000100:00100000:2.0:1782487587.820972:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16466 00000100:00100000:3.0:1782487587.820984:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299274752 00000100:00100000:1.0:1782487587.820984:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.820991:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299274112 00000100:00100000:2.0:1782487587.820995:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299274112 00000100:00100000:1.0:1782487587.821015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.821026:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299274880 00000100:00100000:2.0:1782487587.821031:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299274880 00000100:00100000:3.0:1782487587.821047:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299274752 00000100:00100000:2.0:1782487587.821056:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16476 00000100:00100000:2.0:1782487587.821066:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+104:3316:x1869066299274112:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.821076:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16477 00002000:00080000:2.0:1782487587.821079:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6177 count 1 00000100:00100000:1.0:1782487587.821088:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16478 00000100:00100000:3.0:1782487587.821089:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:3316:x1869066299274880:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.821089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.821093:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821101:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+113:3316:x1869066299274752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487587.821105:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6171 count 1 00010000:00010000:2.0:1782487587.821111:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 96 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.821114:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6174 count 1 00010000:00010000:3.0:1782487587.821118:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821126:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1821:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.821128:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821130:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.821139:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821148:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 68 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821158:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.821163:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 96 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821163:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.821168:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821172:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 75 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821185:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 96 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821199:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.821208:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.821214:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 68 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821215:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.821218:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299275136:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.821234:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 68 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821248:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 75 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821251:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299275264:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.821257:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 75 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821268:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299275392:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.821275:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.821282:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.821291:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.821306:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299274624:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.821308:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427648 00000100:00100000:3.0:1782487587.821314:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427648 00000100:00100000:1.0:1782487587.821314:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299274496:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.821323:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821332:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821333:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 76 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821343:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.821349:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821352:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427776 00000100:00100000:3.0:1782487587.821358:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427776 00010000:00010000:2.0:1782487587.821360:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.821366:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821366:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782487587.821374:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821378:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299275008:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.821381:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821398:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821411:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.821418:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85e930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821434:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294427904 00000100:00100000:3.0:1782487587.821439:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294427904 00010000:00010000:2.0:1782487587.821440:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.821445:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.821449:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.821452:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299275008 00010000:00010000:3.0:1782487587.821457:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 78 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.821457:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299275008 00010000:00010000:2.0:1782487587.821469:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821479:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821480:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6367 00000100:00100000:1.0:1782487587.821487:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16479 00000100:00100000:3.0:1782487587.821493:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2360:x1869066294427648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.821497:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+105:3315:x1869066299275008:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.821498:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821503:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.821512:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.821512:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6176 count 1 00010000:00010000:2.0:1782487587.821514:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821527:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821538:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821545:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821547:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.821554:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace5651b/0x66475b4e8b8594ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e9c expref: 78 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821555:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1820:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.821560:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.821564:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821568:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.821572:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.821577:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821585:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821592:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821602:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821627:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.821646:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299275520:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.821661:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc96850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2360:x1869066294427648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.821670:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6367 00000100:00100000:1.0:1782487587.821682:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.821700:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821709:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821715:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6368 00010000:00010000:1.0:1782487587.821717:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821725:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.821726:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+76:2360:x1869066294427776:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.821742:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.821777:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+114:3314:x1869066299272064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5507us (5601us total) trans 8589940124 rc 0/0 00000100:00100000:2.0:1782487587.821785:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16467 00010000:00010000:3.0:1782487587.821797:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.821804:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 76 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821816:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 76 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821825:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821833:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ddd8ab/0x66475b4e8b8594f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1819:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ea3 expref: 76 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821853:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821858:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.821866:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1819:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.821867:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821873:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821881:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.821885:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.821899:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1782487587.821911:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.821934:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+114:3316:x1869066299273344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3293us (3421us total) trans 8589940125 rc 0/0 00000100:00100000:1.0:1782487587.821943:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473 00000100:00100000:3.0:1782487587.821944:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:2360:x1869066294427776:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 223us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.821950:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6368 00010000:00010000:1.0:1782487587.821963:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.821968:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821978:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.821982:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.821991:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822004:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822012:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002edd8db4/0x66475b4e8b85e93e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1814:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822034:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.822038:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822046:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.822050:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.822058:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6369 00010000:00010000:1.0:1782487587.822059:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.822062:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+114:3314:x1869066299271040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6876us (7188us total) trans 8589940126 rc 0/0 00000100:00100000:3.0:1782487587.822073:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2361:x1869066294427904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.822079:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465 00010000:00010000:3.0:1782487587.822086:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.822086:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822093:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 74 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822095:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d716a1/0x66475b4e8b85e968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822101:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.822109:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822114:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 74 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822115:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.822119:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.822122:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.822125:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.822132:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822136:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822139:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b7e5b0e/0x66475b4e8b859514 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ebf expref: 74 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822149:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822152:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822169:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822171:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822198:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822203:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85e937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1812:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822221:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.822230:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.822235:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822253:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.822259:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822261:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.822270:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.822273:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822276:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822291:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822293:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.822309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.822313:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85e96f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822323:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.822330:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.822334:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.822337:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.822340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.822352:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.822354:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2361:x1869066294427904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 286us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.822373:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6369 00010000:00010000:2.0:1782487587.822382:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.822390:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+114:3314:x1869066299274240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2627us (2849us total) trans 8589940127 rc 0/0 00000100:00100000:3.0:1782487587.822391:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428032 00010000:00010000:2.0:1782487587.822394:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.822395:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428032 00000100:00100000:1.0:1782487587.822401:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16474 00010000:00010000:2.0:1782487587.822411:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822413:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.822434:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299275264:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.822437:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.822437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.822439:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428288 00010000:00010000:1.0:1782487587.822451:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822473:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.822478:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822485:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.822489:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822498:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822514:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822522:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f89cd05c/0x66475b4e8b85e976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.822542:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.822545:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.822547:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.822570:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428288 00000004:00080000:1.0:1782487587.822575:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd4700/2, rc 0, transno 8589940127 00000100:00100000:1.0:1782487587.822586:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299274240:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.822589:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 73 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.822595:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+114:3314:x1869066299274368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2814us (2951us total) trans 8589940128 rc 0/0 00000004:00080000:1.0:1782487587.822603:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df4380/2, rc 0, transno 8589940124 00000100:00100000:1.0:1782487587.822628:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299272064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.822633:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16475 00000100:00100000:3.0:1782487587.822634:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428160 00000100:00100000:3.0:1782487587.822640:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428160 00000100:00100000:0.0:1782487587.822640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:1.0:1782487587.822643:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df7800/2, rc 0, transno 8589940779 00000100:00100000:1.0:1782487587.822654:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299271168:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.822655:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.822657:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 97 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822666:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.822672:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4e5d54700/2, rc 0, transno 8589940126 00000100:00100000:3.0:1782487587.822677:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428416 00000100:00100000:1.0:1782487587.822678:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4e5d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299271040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.822680:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428416 00010000:00010000:3.0:1782487587.822693:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 98 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.822694:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299275136:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.822700:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd6680/2, rc 0, transno 8589940128 00000100:00100000:1.0:1782487587.822709:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299274368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.822711:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822736:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822747:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.822754:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6370 00000100:00100000:3.0:1782487587.822769:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+69:2361:x1869066294428032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.822769:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822782:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.822784:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822791:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822805:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.822806:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.822825:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab28750/0x66475b4e8b859a07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477008 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.822825:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299275520:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.822843:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.822843:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822848:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.822853:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822860:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.822869:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299275648:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.822882:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.822904:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.822915:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+68:2361:x1869066294428032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 149us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.822922:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6370 00000100:00100000:1.0:1782487587.822928:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299276160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.822939:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6371 00000100:00100000:3.0:1782487587.822949:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2361:x1869066294428288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.822957:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.822963:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 73 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.822966:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.822976:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 73 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.822990:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.822993:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.822998:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+106:3316:x1869066299272704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5638us (6387us total) trans 8589940780 rc 0/0 00010000:00010000:3.0:1782487587.823000:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.823000:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.823011:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299276032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.823014:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469 00010000:00010000:3.0:1782487587.823016:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823034:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.823035:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299275648 00000100:00100000:2.0:1782487587.823040:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299275648 00000100:00100000:1.0:1782487587.823044:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.823066:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2361:x1869066294428288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.823070:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299276160 00000100:00100000:2.0:1782487587.823074:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299276160 00000100:00100000:3.0:1782487587.823076:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6371 00010000:00010000:1.0:1782487587.823084:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823092:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.823100:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6372 00000100:00100000:2.0:1782487587.823102:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299276032 00000100:00100000:2.0:1782487587.823106:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299276032 00010000:00010000:1.0:1782487587.823108:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.823111:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+98:2360:x1869066294428160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.823117:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823121:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.823132:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.823133:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16480 00010000:00010000:3.0:1782487587.823137:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.823147:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+106:3315:x1869066299275648:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.823163:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.823165:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6178 count 1 00010000:00010000:2.0:1782487587.823182:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823184:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c62d43dd/0x66475b4e8b856d91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761e5 expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823217:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 98 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823219:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.823228:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.823232:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1822:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.823235:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823237:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.823245:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823264:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 98 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823274:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 98 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.823287:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299276288:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.823316:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.823330:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.823342:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.823346:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823349:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.823357:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.823361:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823371:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823386:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823400:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85e94c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823420:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.823425:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823432:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.823437:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823446:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823459:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823466:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85e98b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.823471:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+97:2360:x1869066294428160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 271us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.823483:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6372 00010000:00010000:2.0:1782487587.823490:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.823494:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.823497:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.823504:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6373 00000100:00100000:2.0:1782487587.823516:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16481 00000100:00100000:1.0:1782487587.823524:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+116:3316:x1869066299274752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2426us (2660us total) trans 8589940129 rc 0/0 00000100:00100000:2.0:1782487587.823529:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+116:3315:x1869066299276160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.823538:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16478 00002000:00080000:2.0:1782487587.823543:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6177 count 1 00000100:00100000:3.0:1782487587.823551:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+96:2360:x1869066294428416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.823556:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823562:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.823562:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16482 00010000:00010000:3.0:1782487587.823571:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823576:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 67 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.823576:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+115:3315:x1869066299276032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.823591:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1821:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.823592:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.823593:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6176 count 1 00010000:00010000:2.0:1782487587.823599:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.823628:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823632:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823633:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1890e65/0x66475b4e8b856dad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476208 expref: 96 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823650:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.823650:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823654:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.823657:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.823658:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 67 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823660:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823662:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1820:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.823669:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.823671:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823677:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823684:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823686:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 67 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.823703:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823717:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.823718:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299276416:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.823733:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823738:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.823738:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.823751:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.823757:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299276544:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.823762:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+95:2360:x1869066294428416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 251us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.823767:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.823777:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6373 00000100:00100000:1.0:1782487587.823784:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.823796:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823805:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823807:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823819:0:213221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcc23da8/0x66475b4e8b859021 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1817:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d0d expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823828:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823847:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823850:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.823855:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.823866:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.823869:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.823892:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.823899:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1782487587.823910:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299272960:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.823926:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823934:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823941:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823949:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823957:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.823970:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1782487587.824085:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44a0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+109:3314:x1869066299270272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12832us (12923us total) trans 8589940781 rc 0/0 00000100:00100000:0.0:1782487587.824094:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16459 00010000:00010000:0.0:1782487587.824118:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782487587.824123:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824125:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+108:3315:x1869066299275008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2628us (2717us total) trans 8589940782 rc 0/0 00000100:00100000:2.0:1782487587.824140:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3316:x1869066299274112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3075us (3180us total) trans 8589940783 rc 0/0 00000100:00100000:1.0:1782487587.824141:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16479 00010000:00010000:0.0:1782487587.824145:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8dc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.824152:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.824156:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16476 00010000:00010000:1.0:1782487587.824164:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782487587.824168:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824170:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824181:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.824200:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824205:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.824219:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+116:3314:x1869066299272192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7753us (7913us total) trans 8589940130 rc 0/0 00010000:00010000:1.0:1782487587.824222:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.824226:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb452642800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.824228:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824234:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f045e4/0x66475b4e8b85e906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1816:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.824235:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16468 00010000:00010000:2.0:1782487587.824235:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824241:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824264:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824270:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824273:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089558893/0x66475b4e8b856350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1818:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a475ee3 expref: 94 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824274:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.824280:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824283:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824284:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85e97d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824303:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651c7290/0x66475b4e8b85e992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824311:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.824319:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824321:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.824325:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.824328:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.824330:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.824331:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.824335:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824343:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.824353:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df6d80/2, rc 0, transno 8589940130 00010000:00010000:2.0:1782487587.824354:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.824362:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299269248:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.824363:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824366:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299272192:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.824369:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824380:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.824381:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44a0e6d80/2, rc 0, transno 8589940781 00000100:00100000:1.0:1782487587.824390:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299270272:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.824393:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85e945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1817:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824394:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824397:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824421:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824422:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824432:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824437:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824442:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.824446:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782487587.824448:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.824451:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd6a00/2, rc 0, transno 8589940782 00010000:00010000:0.0:1782487587.824462:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.824466:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299275008:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.824467:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824479:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824496:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824501:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.824503:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824514:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85e914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1819:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824515:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299276928:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.824533:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824537:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824540:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.824552:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.824553:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.824566:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.824592:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299276928 00000100:00100000:2.0:1782487587.824595:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+107:3317:x1869066299270912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10417us (10584us total) trans 8589940784 rc 0/0 00000100:00100000:1.0:1782487587.824597:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299276928 00000100:00100000:2.0:1782487587.824627:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16461 00000100:00100000:2.0:1782487587.824646:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16483 00000100:00100000:2.0:1782487587.824657:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+107:3314:x1869066299276928:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.824660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00002000:00080000:2.0:1782487587.824672:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6180 count 1 00010000:00010000:2.0:1782487587.824686:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824686:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.824688:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299275904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.824694:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824717:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.824724:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824725:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 98 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824725:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.824744:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299276800:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.824748:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1824:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.824750:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824752:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.824761:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.824771:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824772:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.824783:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b372302/0x66475b4e8b85e8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1818:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.824787:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 98 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.824799:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44a0e5c00/2, rc 0, transno 8589940784 00010000:00010000:0.0:1782487587.824810:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.824812:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 98 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.824813:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299270912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.824814:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.824818:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.824829:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb54770fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+108:3314:x1869066299268992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16806us (17345us total) trans 8589940785 rc 0/0 00000100:00100000:1.0:1782487587.824830:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782487587.824835:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299277056:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.824839:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299275776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.824841:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16455 00000100:00100000:0.0:1782487587.824851:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.824887:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.824894:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591260c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.824911:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.824911:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299276672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.824936:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299276416:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.824943:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.824955:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.824981:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299275904 00000100:00100000:2.0:1782487587.824985:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299275904 00000100:00100000:2.0:1782487587.825016:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299275776 00000100:00100000:1.0:1782487587.825016:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299276800 00000100:00100000:0.0:1782487587.825021:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299276672 00000100:00100000:1.0:1782487587.825024:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299276800 00000100:00100000:0.0:1782487587.825027:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299276672 00000100:00100000:1.0:1782487587.825053:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16484 00000100:00100000:1.0:1782487587.825062:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+117:3317:x1869066299275904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.825070:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16485 00002000:00080000:1.0:1782487587.825074:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6175 count 1 00000100:00100000:3.0:1782487587.825078:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+117:3317:x1869066299276800:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.825086:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487587.825088:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6182 count 1 00010000:00010000:1.0:1782487587.825098:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825099:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825107:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.825110:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 67 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825110:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.825114:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825117:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.825121:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.825124:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825134:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.825135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.825141:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 67 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825148:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825150:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 67 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825159:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299277312:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.825160:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16486 00000100:00100000:3.0:1782487587.825161:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299277440:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.825175:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+108:3317:x1869066299276672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.825182:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299275776 00000100:00100000:1.0:1782487587.825204:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.825223:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16487 00000100:00100000:3.0:1782487587.825233:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.825233:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299276544:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.825234:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+118:3317:x1869066299275776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.825251:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6173 count 1 00000100:00100000:3.0:1782487587.825252:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428544 00010000:00010000:1.0:1782487587.825252:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.825257:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428544 00010000:00010000:2.0:1782487587.825264:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825278:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 99 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825279:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825279:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299277184:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.825296:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6179 count 1 00010000:00010000:2.0:1782487587.825302:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.825311:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.825312:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.825314:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825320:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.825321:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428672 00000100:00100000:3.0:1782487587.825326:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428672 00010000:00010000:0.0:1782487587.825338:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 99 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825344:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 68 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.825349:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb54770ca80/2, rc 0, transno 8589940785 00010000:00010000:0.0:1782487587.825351:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1823:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.825352:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825358:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb54770ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299268992:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.825362:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1823:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.825367:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428800 00000100:00100000:3.0:1782487587.825374:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428800 00010000:00010000:0.0:1782487587.825374:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825379:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825391:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825397:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299277696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.825406:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299277568:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.825415:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 99 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.825428:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 99 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825434:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.825450:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.825457:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299277824:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.825462:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd5500/2, rc 0, transno 8589940783 00000100:00100000:3.0:1782487587.825464:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6374 00000100:00100000:2.0:1782487587.825469:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299277184 00000100:00100000:1.0:1782487587.825473:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.825474:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294428544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.825474:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299277184 00010000:00010000:3.0:1782487587.825487:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1782487587.825491:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd7800/2, rc 0, transno 8589940129 00010000:00010000:3.0:1782487587.825493:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 99 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825502:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274752:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.825506:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 99 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.825509:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299277696 00000100:00100000:2.0:1782487587.825513:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299277696 00000004:00080000:1.0:1782487587.825516:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c3aa00/2, rc 0, transno 8589940125 00010000:00010000:3.0:1782487587.825522:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1822:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.825522:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299273344:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.825526:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.825531:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.825536:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb453dd1c00/2, rc 0, transno 8589940780 00010000:00010000:3.0:1782487587.825538:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.825541:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16488 00000100:00100000:1.0:1782487587.825541:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299272704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.825554:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:3315:x1869066299277184:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.825559:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1782487587.825567:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6181 count 1 00010000:00010000:2.0:1782487587.825581:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.825584:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294428544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (928us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.825598:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 99 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825629:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1825:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.825633:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.825638:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.825656:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fc300 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.825661:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 99 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825674:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 99 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.825687:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299278208:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.825694:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16489 00000100:00100000:3.0:1782487587.825701:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6374 00000100:00100000:1.0:1782487587.825703:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+110:3316:x1869066299277696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.825715:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6183 count 1 00010000:00010000:1.0:1782487587.825727:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.825737:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126780 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.825739:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 98 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.825740:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6375 00010000:00010000:1.0:1782487587.825747:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1827:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.825751:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.825755:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825774:0:190930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018aba076/0x66475b4e8b856da6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x181e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4761fa expref: 93 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.825788:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299273856:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.825789:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 98 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825805:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825806:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 98 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825830:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825846:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.825847:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299278592:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.825862:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.825868:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+69:2363:x1869066294428672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.825873:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825880:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.825887:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.825890:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 69 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.825890:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.825891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.825900:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.825905:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825906:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 69 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825913:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.825918:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825923:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e09e2a4a/0x66475b4e8b859f4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1821:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477120 expref: 69 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825926:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825934:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.825937:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1821:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.825940:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825942:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825948:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85e961 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x181e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.825951:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.825970:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.825973:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.825976:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.825977:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.825999:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299278080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.826009:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+68:2363:x1869066294428672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 146us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.826017:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6375 00000100:00100000:1.0:1782487587.826032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.826061:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.826070:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299278336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.826076:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+111:3315:x1869066299273088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7930us (8045us total) trans 8589940786 rc 0/0 00000100:00100000:2.0:1782487587.826085:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16472 00000100:00100000:2.0:1782487587.826104:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299278080 00000100:00100000:3.0:1782487587.826107:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294428928 00000100:00100000:1.0:1782487587.826108:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.826109:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299278080 00000100:00100000:3.0:1782487587.826112:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294428928 00010000:00010000:3.0:1782487587.826133:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.826139:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299278336 00000100:00100000:2.0:1782487587.826144:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299278336 00000100:00100000:1.0:1782487587.826148:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16490 00000100:00100000:3.0:1782487587.826155:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6376 00000100:00100000:1.0:1782487587.826159:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+119:3314:x1869066299278080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.826162:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+67:2361:x1869066294428800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.826170:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1782487587.826172:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6178 count 1 00000100:00100000:2.0:1782487587.826175:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16491 00010000:00010000:3.0:1782487587.826176:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826198:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.826199:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+111:3314:x1869066299278336:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.826203:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826217:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 67 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.826218:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6184 count 1 00010000:00010000:3.0:1782487587.826222:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff531f8/0x66475b4e8b859a15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1820:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477024 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826229:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1822:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.826232:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.826235:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826237:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826239:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.826246:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1820:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.826254:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826262:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 99 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826265:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826272:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 66 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826280:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1828:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.826288:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.826292:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 66 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826293:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.826294:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826319:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299278720:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.826323:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+66:2361:x1869066294428800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (1193us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.826329:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 99 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.826334:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6376 00000100:00100000:1.0:1782487587.826345:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.826347:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 99 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.826356:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6377 00010000:00010000:1.0:1782487587.826364:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.826365:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299278848:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.826370:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294428928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.826377:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826381:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.826385:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826386:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826394:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.826402:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126e40 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.826411:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.826426:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.826429:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.826438:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826439:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826464:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.826464:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb0c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.826471:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826496:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.826498:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826505:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 99 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826523:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.826524:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.826536:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e363c/0x66475b4e8b85e9a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1820:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826537:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+120:3315:x1869066299276032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2964us (3494us total) trans 8589940131 rc 0/0 00000100:00100000:1.0:1782487587.826551:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16482 00010000:00010000:3.0:1782487587.826568:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.826571:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.826571:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.826577:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826579:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.826590:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df7480/2, rc 0, transno 8589940131 00010000:00010000:0.0:1782487587.826599:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.826601:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826602:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299276032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.826626:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.826638:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb546c3ad80/2, rc 0, transno 8589940786 00000100:00100000:1.0:1782487587.826650:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb546c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299273088:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.826654:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826655:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.826671:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.826680:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85e9a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1821:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.826684:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+99:2361:x1869066294428928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 318us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.826705:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+120:3315:x1869066299276160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3180us (3739us total) trans 8589940132 rc 0/0 00010000:00010000:0.0:1782487587.826709:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.826714:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16481 00010000:00010000:0.0:1782487587.826714:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.826720:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.826727:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44a0e5500/2, rc 0, transno 8589940132 00000100:00100000:1.0:1782487587.826738:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44a0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299276160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.826744:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.826755:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299279104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.826756:0:213224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace12d8d/0x66475b4e8b856f6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476278 expref: 99 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.826773:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299276288:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.826780:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.826789:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826789:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.826800:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826808:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826818:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.826826:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826835:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299279104 00000100:00100000:1.0:1782487587.826838:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299279104 00010000:00010000:2.0:1782487587.826842:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.826862:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16492 00000100:00100000:1.0:1782487587.826871:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+112:3315:x1869066299279104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.826883:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6186 count 1 00010000:00010000:1.0:1782487587.826896:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826910:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 92 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.826914:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6377 00010000:00010000:1.0:1782487587.826917:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.826920:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.826924:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826947:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 92 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.826958:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 92 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826961:0:195192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f014a62/0x66475b4e8b8594ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eaa expref: 71 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.826970:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299279360:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.826972:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299275392:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.826989:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.826998:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827000:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+113:3315:x1869066299275648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3856us (4094us total) trans 8589940787 rc 0/0 00000100:00100000:1.0:1782487587.827012:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.827015:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827016:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16480 00010000:00010000:3.0:1782487587.827028:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827036:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299277312:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.827040:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.827046:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827050:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827056:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.827062:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.827067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.827089:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827096:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487587.827097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.827108:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299279232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.827111:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827120:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85e999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.827129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.827142:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.827144:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.827148:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.827151:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.827159:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827174:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299277568:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.827176:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.827177:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299279232 00000100:00100000:1.0:1782487587.827182:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299279232 00000100:00100000:0.0:1782487587.827184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.827206:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827226:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16493 00000100:00100000:1.0:1782487587.827236:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+120:3314:x1869066299279232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.827248:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6181 count 1 00000100:00100000:2.0:1782487587.827258:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299278208:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.827261:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.827269:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299277824:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.827274:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827277:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 65 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.827288:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827298:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=3s v=(0 0) 00000100:00100000:2.0:1782487587.827301:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429184 00010000:00010000:1.0:1782487587.827304:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.827306:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429184 00010000:00010000:1.0:1782487587.827309:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827326:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 66 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827334:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 66 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827347:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 66 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827348:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429312 00000100:00100000:3.0:1782487587.827349:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:3316:x1869066299274880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6264us (6334us total) trans 8589940133 rc 0/0 00000100:00100000:2.0:1782487587.827353:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429312 00000100:00100000:3.0:1782487587.827361:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16477 00010000:00010000:2.0:1782487587.827369:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827370:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299279488:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.827392:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429056 00000100:00100000:2.0:1782487587.827395:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429056 00010000:00010000:2.0:1782487587.827408:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 67 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827414:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.827421:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429440 00000100:00100000:2.0:1782487587.827424:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429440 00010000:00010000:1.0:1782487587.827431:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.827436:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827438:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.827440:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6378 00000100:00100000:3.0:1782487587.827454:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+67:2361:x1869066294429184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.827457:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.827463:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.827468:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.827475:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827479:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827486:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6379 00000100:00100000:2.0:1782487587.827499:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2363:x1869066294429312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.827499:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.827510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.827513:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.827518:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85e984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827522:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827536:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.827537:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.827541:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.827544:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.827545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.827561:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db02a7a/0x66475b4e8b857229 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47633c expref: 98 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827566:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299278592:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.827580:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.827584:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.827588:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827590:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.827629:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827642:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.827651:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f20df266/0x66475b4e8b859a0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477016 expref: 67 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.827660:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd5180/2, rc 0, transno 8589940787 00010000:00010000:2.0:1782487587.827665:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.827672:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299275648:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.827682:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827692:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+97:2363:x1869066294429312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.827708:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6379 00010000:00010000:0.0:1782487587.827712:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827719:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299278720:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.827725:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429568 00010000:00010000:0.0:1782487587.827725:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827730:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429568 00010000:00010000:1.0:1782487587.827731:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827745:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 97 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.827747:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827756:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299277952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.827769:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429696 00000100:00100000:2.0:1782487587.827772:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429696 00010000:00010000:0.0:1782487587.827777:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.827785:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 98 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827795:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.827806:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6380 00000100:00100000:2.0:1782487587.827816:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+66:2361:x1869066294429056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.827822:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299278976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.827824:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.827832:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 66 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827844:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 66 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827854:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.827858:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.827863:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.827867:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.827876:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827877:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782487587.827888:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299278464:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.827903:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.827913:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.827918:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.827923:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.827929:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.827930:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+66:2361:x1869066294429056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 114us (802us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.827935:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.827942:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6380 00000100:00100000:1.0:1782487587.827949:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299279616:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.827963:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.827964:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6381 00000100:00100000:0.0:1782487587.827964:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+113:3317:x1869066299276672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2790us (3020us total) trans 8589940788 rc 0/0 00000100:00100000:2.0:1782487587.827977:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2361:x1869066294429440:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.827980:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.827980:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16486 00000100:00100000:3.0:1782487587.827987:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+65:2361:x1869066294429184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 535us (923us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.827990:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.828000:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828004:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299277952 00000100:00100000:3.0:1782487587.828008:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6378 00000004:00080000:1.0:1782487587.828011:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6bb80/2, rc 0, transno 8589940788 00000100:00100000:0.0:1782487587.828011:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299277952 00010000:00010000:2.0:1782487587.828026:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.828026:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299276672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.828039:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299278976 00000100:00100000:0.0:1782487587.828042:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299278976 00010000:00010000:2.0:1782487587.828046:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378ce2ff/0x66475b4e8b859744 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x181d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f36 expref: 71 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828060:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.828061:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299278464 00000100:00100000:0.0:1782487587.828065:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299278464 00010000:00010000:2.0:1782487587.828066:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x181d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.828072:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299279744:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.828073:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828077:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299279616 00000100:00100000:0.0:1782487587.828081:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299279616 00010000:00010000:2.0:1782487587.828088:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828099:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16494 00000100:00100000:1.0:1782487587.828110:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.828110:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+122:3317:x1869066299277952:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.828114:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1782487587.828124:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6179 count 1 00000100:00100000:2.0:1782487587.828138:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:2361:x1869066294429440:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (956us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.828138:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828142:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.828176:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6382 00010000:00010000:1.0:1782487587.828179:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828183:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 64 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828184:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6381 00000100:00100000:3.0:1782487587.828200:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2361:x1869066294429568:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.828212:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828213:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.828214:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1823:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.828219:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 98 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828223:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.828226:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828231:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6383 00010000:00010000:0.0:1782487587.828233:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828240:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 98 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828246:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+98:2361:x1869066294429696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.828254:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.828262:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.828268:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000354c7c58/0x66475b4e8b8575b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47649a expref: 98 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828272:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 98 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828272:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 64 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828289:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.828298:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.828298:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 64 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828303:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 97 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828306:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828330:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828332:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299279872:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.828337:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000216cb999/0x66475b4e8b85742f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f9 expref: 97 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828359:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.828363:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.828367:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.828368:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828374:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fcf00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.828381:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.828386:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+123:3317:x1869066299275904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3322us (3662us total) trans 8589940134 rc 0/0 00000100:00100000:3.0:1782487587.828394:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+96:2361:x1869066294429568:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 209us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.828401:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16484 00000100:00100000:3.0:1782487587.828410:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6382 00000100:00100000:1.0:1782487587.828420:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299279744 00000100:00100000:1.0:1782487587.828423:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299279744 00010000:00010000:2.0:1782487587.828424:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.828439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.828448:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16495 00010000:00010000:3.0:1782487587.828450:0:213213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087d9fca7/0x66475b4e8b85a0f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771b3 expref: 64 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828454:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294429696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 209us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.828461:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+122:3317:x1869066299278976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.828472:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6383 00002000:00080000:1.0:1782487587.828477:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6180 count 1 00000100:00100000:3.0:1782487587.828479:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299277440:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.828491:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429824 00010000:00010000:1.0:1782487587.828491:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828496:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429824 00010000:00010000:3.0:1782487587.828497:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828506:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 64 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828516:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 64 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828517:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.828520:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1824:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.828528:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.828536:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828538:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828547:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828547:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294429952 00000100:00100000:2.0:1782487587.828552:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294429952 00010000:00010000:1.0:1782487587.828559:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 64 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828560:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828568:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 95 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828574:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 64 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828576:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487587.828588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.828592:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6384 00000100:00100000:1.0:1782487587.828600:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299280000:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.828627:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+64:2361:x1869066294429824:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.828637:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.828643:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 64 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828657:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 64 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.828669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.828676:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8b8809/0x66475b4e8b859f5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1822:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47712e expref: 64 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.828683:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.828697:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.828699:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.828701:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1822:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.828705:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828707:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828726:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828728:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.828731:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.828735:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828739:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828750:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.828757:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828758:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.828766:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828775:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2361:x1869066294429824:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (335us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.828776:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828778:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828791:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6384 00000100:00100000:2.0:1782487587.828808:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430080 00010000:00010000:1.0:1782487587.828810:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064241c79/0x66475b4e8b85e9ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828811:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828813:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430080 00010000:00010000:2.0:1782487587.828829:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 93 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.828830:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:3317:x1869066299276800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3752us (4060us total) trans 8589940135 rc 0/0 00010000:00010000:1.0:1782487587.828838:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.828838:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2bc366e/0x66475b4e8b85e9b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828844:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.828848:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16485 00000100:00100000:2.0:1782487587.828861:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430208 00010000:00010000:1.0:1782487587.828862:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690c00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.828864:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430208 00010000:00010000:1.0:1782487587.828868:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.828873:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16496 00010000:00010000:0.0:1782487587.828874:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.828877:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.828878:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828879:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 63 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.828880:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.828885:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+115:3317:x1869066299278464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782487587.828901:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6182 count 1 00010000:00010000:1.0:1782487587.828903:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828911:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6385 00010000:00010000:3.0:1782487587.828914:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.828914:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031c5a27f/0x66475b4e8b85e9bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.828924:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294429952:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.828931:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.828934:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.828937:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.828938:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16497 00010000:00010000:1.0:1782487587.828941:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.828944:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 95 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828945:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1826:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.828945:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.828951:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+115:3317:x1869066299279616:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.828954:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1826:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.828962:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16498 00010000:00010000:3.0:1782487587.828964:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.828967:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6185 count 1 00010000:00010000:2.0:1782487587.828971:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 95 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.828976:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+115:3317:x1869066299279744:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.828981:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.828991:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.828994:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6193 count 1 00010000:00010000:2.0:1782487587.828995:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.828997:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 93 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829005:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.829007:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829017:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829017:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.829021:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1829:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.829031:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.829034:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 95 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829042:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.829043:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.829047:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299280128:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.829048:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1831:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.829056:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.829067:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829073:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.829079:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45aab9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.829088:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 93 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829093:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 95 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.829101:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6386 00000100:00100000:2.0:1782487587.829101:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294429952:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (586us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.829112:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 93 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.829117:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2360:x1869066294430080:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.829118:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 95 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829122:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6385 00010000:00010000:3.0:1782487587.829130:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.829139:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 93 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829145:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6387 00000100:00100000:1.0:1782487587.829145:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299280384:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.829147:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299280256:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.829161:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 93 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829162:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2360:x1869066294430208:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.829177:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.829181:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.829184:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.829185:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 63 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829202:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.829212:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829219:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 63 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829224:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829225:0:190931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000560a9ad5/0x66475b4e8b85789d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47656c expref: 93 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.829250:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299279360:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.829254:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.829255:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.829260:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1825:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.829262:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829265:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829287:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829288:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.829298:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fc300 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.829308:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.829309:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+92:2360:x1869066294430080:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 197us (723us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.829311:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.829319:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6386 00010000:00010000:1.0:1782487587.829319:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829327:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829338:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2360:x1869066294430208:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 181us (669us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.829340:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.829349:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6387 00010000:00010000:2.0:1782487587.829379:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829388:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829398:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829407:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.829422:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.829493:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+116:3315:x1869066299279104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2622us (2704us total) trans 8589940789 rc 0/0 00000100:00100000:1.0:1782487587.829502:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16492 00010000:00010000:1.0:1782487587.829523:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.829528:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829537:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.829542:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829551:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829565:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829574:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85e9ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829588:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+116:3316:x1869066299277696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3884us (4154us total) trans 8589940790 rc 0/0 00010000:00010000:1.0:1782487587.829591:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.829597:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.829598:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16489 00010000:00010000:1.0:1782487587.829626:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4aabb1a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.829630:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829638:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829651:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829658:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099978ab5/0x66475b4e8b85e9d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829679:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.829683:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.829687:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.829690:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730911c4/0x66475b4e8b857237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47634a expref: 94 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.829703:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299277056:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.829713:0:213225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023356704/0x66475b4e8b85a0eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1825:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ac expref: 62 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829722:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.829727:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299279488:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.829730:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829738:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829744:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829753:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829754:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829762:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829763:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829771:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.829779:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.829779:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.829792:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.829995:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+123:3314:x1869066299279232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2760us (2854us total) trans 8589940136 rc 0/0 00000100:00100000:3.0:1782487587.829996:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+116:3314:x1869066299276928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5342us (5444us total) trans 8589940791 rc 0/0 00000100:00100000:1.0:1782487587.830003:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16493 00000100:00100000:3.0:1782487587.830012:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16483 00010000:00010000:1.0:1782487587.830027:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.830032:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830040:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.830044:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830053:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830068:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830077:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85e9ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830098:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.830101:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830102:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830111:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.830112:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830116:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830127:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830128:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830148:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830151:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830164:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830167:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85e9f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830184:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830205:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830209:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.830211:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782487587.830214:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830222:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.830226:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830234:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830244:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830249:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85e9df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1822:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830265:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830268:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830270:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.830278:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.830305:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c4a80/2, rc 0, transno 8589940136 00000100:00100000:1.0:1782487587.830317:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299279232:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.830337:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6ad80/2, rc 0, transno 8589940791 00000100:00100000:1.0:1782487587.830344:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299276928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.830382:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+123:3314:x1869066299278080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4224us (4349us total) trans 8589940137 rc 0/0 00000100:00100000:2.0:1782487587.830390:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16490 00010000:00010000:2.0:1782487587.830413:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.830419:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299280640:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.830427:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830437:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830453:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.830453:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.830463:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830479:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782487587.830483:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c5880/2, rc 0, transno 8589940789 00000100:00100000:1.0:1782487587.830494:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299279104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.830506:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.830512:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299280512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.830550:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.830574:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299279872:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.830585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.830596:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.830630:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299280640 00000100:00100000:1.0:1782487587.830634:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299280640 00000100:00100000:3.0:1782487587.830650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.830660:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299280512 00000100:00100000:1.0:1782487587.830663:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299280512 00000100:00100000:3.0:1782487587.830682:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430464 00000100:00100000:2.0:1782487587.830687:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+124:3317:x1869066299275776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5454us (5799us total) trans 8589940138 rc 0/0 00000100:00100000:3.0:1782487587.830689:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430464 00000100:00100000:1.0:1782487587.830692:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16499 00000100:00100000:1.0:1782487587.830702:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+116:3315:x1869066299280640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.830707:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16500 00000100:00100000:2.0:1782487587.830714:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16487 00002000:00080000:1.0:1782487587.830716:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6187 count 1 00000100:00100000:0.0:1782487587.830721:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+124:3315:x1869066299280512:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.830723:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 62 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830729:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830733:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.830741:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.830741:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6183 count 1 00010000:00010000:2.0:1782487587.830756:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.830758:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 91 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.830759:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830761:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.830765:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430336 00000100:00100000:3.0:1782487587.830771:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430336 00010000:00010000:1.0:1782487587.830784:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.830789:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.830791:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 63 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830791:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.830792:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830804:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830815:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.830821:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=3s v=(0 0) 00000100:00100000:3.0:1782487587.830832:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6388 00010000:00010000:0.0:1782487587.830832:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.830836:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb66868/0x66475b4e8b85e9c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x181d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.830842:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.830847:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 91 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.830849:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2360:x1869066294430464:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.830856:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.830861:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.830864:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.830867:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.830874:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 91 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830877:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.830885:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.830891:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 63 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830902:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.830906:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299280896:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.830918:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.830927:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.830937:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299281024:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.830939:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.830958:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.830959:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.830973:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fcf00 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.830985:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 63 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.831007:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b6f8c9/0x66475b4e8b859f63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1823:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477135 expref: 63 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831011:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299280000:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.831028:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.831030:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.831036:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1823:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.831043:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831057:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299280768:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.831065:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831091:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.831092:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.831124:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+62:2360:x1869066294430464:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 279us (542us total) trans 0 rc 0/0 00000004:00080000:1.0:1782487587.831135:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d68380/2, rc 0, transno 8589940790 00000100:00100000:3.0:1782487587.831145:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6388 00000100:00100000:2.0:1782487587.831147:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+117:3315:x1869066299277184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5594us (5835us total) trans 8589940792 rc 0/0 00000100:00100000:1.0:1782487587.831152:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299277696:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.831157:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.831159:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16488 00010000:00010000:0.0:1782487587.831169:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.831170:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd7480/2, rc 0, transno 8589940133 00010000:00010000:0.0:1782487587.831183:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831184:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299274880:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.831210:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.831227:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.831268:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782487587.831270:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299280768 00010000:00010000:1.0:1782487587.831273:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.831275:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299280768 00010000:00010000:1.0:1782487587.831290:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49c200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.831295:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831304:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.831309:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16501 00000100:00100000:2.0:1782487587.831322:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+117:3316:x1869066299280768:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.831326:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.831335:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6189 count 1 00010000:00010000:1.0:1782487587.831336:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ace3d9/0x66475b4e8b85e9d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1825:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831351:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831358:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.831363:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831365:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831387:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182d:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.831387:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.831395:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.831395:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.831396:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+124:3317:x1869066299277952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3286us (3601us total) trans 8589940139 rc 0/0 00010000:00010000:2.0:1782487587.831404:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831422:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.831427:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16494 00010000:00010000:2.0:1782487587.831437:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831440:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831454:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831457:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c3e4dad/0x66475b4e8b85e9fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1823:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.831476:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299281408:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.831486:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.831490:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.831494:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.831514:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.831522:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299280384:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.831529:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.831539:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.831549:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299281280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.831561:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.831571:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.831578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.831597:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6389 00000100:00100000:1.0:1782487587.831603:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487587.831663:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d68000/2, rc 0, transno 8589940137 00000100:00100000:2.0:1782487587.831677:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299278080:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.831702:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6b480/2, rc 0, transno 8589940139 00000100:00100000:1.0:1782487587.831711:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299277952:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.831728:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd7100/2, rc 0, transno 8589940138 00000100:00100000:0.0:1782487587.831734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.831738:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299275776:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.831755:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd4a80/2, rc 0, transno 8589940134 00000100:00100000:2.0:1782487587.831758:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281280 00000100:00100000:2.0:1782487587.831762:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281280 00000100:00100000:1.0:1782487587.831769:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299275904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.831774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.831777:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299280128:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.831791:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281152 00000100:00100000:2.0:1782487587.831796:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281152 00010000:00010000:3.0:1782487587.831799:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831811:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16502 00000100:00100000:0.0:1782487587.831819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.831824:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+118:3314:x1869066299281280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.831834:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6188 count 1 00000100:00100000:2.0:1782487587.831837:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16503 00000100:00100000:3.0:1782487587.831843:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430592 00010000:00010000:1.0:1782487587.831844:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.831849:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430592 00000100:00100000:2.0:1782487587.831850:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+124:3316:x1869066299281152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.831860:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299280256:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.831866:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 91 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.831871:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6184 count 1 00010000:00010000:1.0:1782487587.831873:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.831876:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831877:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.831884:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831885:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831913:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831922:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1828:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.831923:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 91 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831928:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.831934:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 94 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.831937:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.831948:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 91 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.831967:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299282048:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.831977:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.831979:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430720 00000100:00100000:3.0:1782487587.831986:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430720 00010000:00010000:2.0:1782487587.831991:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832007:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299282176:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.832008:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 95 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.832010:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.832027:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281664:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.832030:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430848 00000100:00100000:3.0:1782487587.832034:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430848 00000100:00100000:2.0:1782487587.832039:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.832053:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 92 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832063:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299281536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.832066:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.832079:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6390 00000100:00100000:3.0:1782487587.832090:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+95:2361:x1869066294430592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.832100:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.832103:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.832113:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281792:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.832136:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6b100/2, rc 0, transno 8589940792 00000100:00100000:1.0:1782487587.832146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.832149:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299277184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.832161:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782487587.832165:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.832171:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299281920:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.832174:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.832200:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.832200:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281664 00000100:00100000:1.0:1782487587.832207:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281664 00000100:00100000:2.0:1782487587.832214:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.832238:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281536 00000100:00100000:1.0:1782487587.832243:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281536 00010000:00010000:3.0:1782487587.832271:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e3c957/0x66475b4e8b8575be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1826:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4764a8 expref: 95 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832274:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281792 00000100:00100000:1.0:1782487587.832277:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299281920 00000100:00100000:2.0:1782487587.832279:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281792 00000100:00100000:1.0:1782487587.832284:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299281920 00000100:00100000:0.0:1782487587.832285:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16504 00010000:00010000:3.0:1782487587.832292:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1826:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.832297:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1826:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.832301:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+128:3316:x1869066299281664:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.832303:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832311:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505 00002000:00080000:0.0:1782487587.832318:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6190 count 1 00010000:00010000:3.0:1782487587.832320:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.832321:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506 00000100:00100000:2.0:1782487587.832326:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4a1df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+128:3315:x1869066299281536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.832334:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+128:3316:x1869066299281792:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.832336:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.832344:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6185 count 1 00002000:00080000:1.0:1782487587.832351:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6188 count 1 00010000:00010000:3.0:1782487587.832356:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.832356:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832359:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832367:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.832380:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182e:0x0].0x0 since=3s v=(0 0) 00000100:00100000:3.0:1782487587.832385:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294430592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 295us (653us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.832389:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.832390:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832398:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 69 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.832401:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.832406:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6390 00010000:00010000:2.0:1782487587.832416:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1829:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.832425:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.832426:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.832434:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.832435:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.832442:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832444:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832467:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.832477:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6391 00010000:00010000:1.0:1782487587.832485:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 69 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.832488:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832493:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.832495:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294430720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.832511:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 69 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.832513:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.832524:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299282432:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.832540:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299282688:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.832544:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299282560:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.832562:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 93 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.832570:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.832577:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.832589:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16507 00000100:00100000:1.0:1782487587.832598:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+128:3315:x1869066299281920:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.832603:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.832637:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299282304:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.832640:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6191 count 1 00010000:00010000:1.0:1782487587.832654:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832668:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 69 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.832688:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.832691:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.832696:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 93 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832696:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832702:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299282304 00000100:00100000:2.0:1782487587.832708:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299282304 00010000:00010000:1.0:1782487587.832735:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 69 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.832737:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16508 00000100:00100000:2.0:1782487587.832749:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+119:3314:x1869066299282304:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.832753:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 69 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.832762:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6195 count 1 00000100:00100000:1.0:1782487587.832763:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299282816:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.832771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.832779:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832793:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 92 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832800:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1833:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.832804:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1833:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.832807:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.832811:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.832812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.832828:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299280896:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.832838:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 92 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.832841:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.832868:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 92 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.832874:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d68e00/2, rc 0, transno 8589940135 00000100:00100000:2.0:1782487587.832880:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299282944:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.832883:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299276800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.832894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.832907:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.832923:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487587.832935:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299283072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.832951:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299281024:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.832955:0:190930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6475060/0x66475b4e8b857428 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4763f2 expref: 93 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.832965:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.832967:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.832970:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299278848:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.832993:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.833002:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299283072 00010000:00010000:2.0:1782487587.833004:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.833008:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299283072 00010000:00010000:2.0:1782487587.833016:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833026:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833034:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.833047:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16509 00010000:00010000:2.0:1782487587.833054:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.833055:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+129:3317:x1869066299283072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.833063:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00002000:00080000:1.0:1782487587.833068:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6186 count 1 00010000:00010000:1.0:1782487587.833080:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.833089:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.833094:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.833096:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.833099:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.833115:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.833122:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.833129:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299283200:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.833162:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.833250:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+120:3314:x1869066299278336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7066us (7144us total) trans 8589940793 rc 0/0 00000100:00100000:2.0:1782487587.833259:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16491 00010000:00010000:2.0:1782487587.833278:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.833284:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833292:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49cc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.833296:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833306:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833319:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833328:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000703571be/0x66475b4e8b85e9e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833345:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.833348:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.833351:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.833375:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6b800/2, rc 0, transno 8589940793 00000100:00100000:2.0:1782487587.833384:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299278336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.833436:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299283328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.833456:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299281408:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.833466:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.833475:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833499:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299283328 00000100:00100000:2.0:1782487587.833503:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299283328 00000100:00100000:2.0:1782487587.833534:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16510 00000100:00100000:2.0:1782487587.833543:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+120:3317:x1869066299283328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.833554:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6191 count 1 00010000:00010000:2.0:1782487587.833565:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833577:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 92 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833585:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182f:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.833588:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.833593:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833632:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 92 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833645:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 92 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833663:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299283456:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.833713:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.833733:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431104 00000100:00100000:2.0:1782487587.833736:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431104 00010000:00010000:2.0:1782487587.833752:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 93 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833770:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294430976 00000100:00100000:2.0:1782487587.833772:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294430976 00010000:00010000:2.0:1782487587.833784:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 62 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833800:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431232 00000100:00100000:2.0:1782487587.833803:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431232 00010000:00010000:2.0:1782487587.833818:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833837:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6392 00000100:00100000:2.0:1782487587.833847:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+94:2361:x1869066294430848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.833856:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.833862:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833874:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833892:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e0b09a9/0x66475b4e8b8579ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476629 expref: 94 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833903:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.833906:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.833911:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833920:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.833946:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:213210:1869066299282176:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.833961:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.833989:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.833995:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc413336/0x66475b4e8b857e62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47679c expref: 92 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834005:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834017:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.834018:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834024:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.834034:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834036:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834053:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834069:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.834079:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299282688:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.834085:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.834097:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834117:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.834121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.834130:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834140:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834142:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.834150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.834153:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834168:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487587.834182:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2361:x1869066294430720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1684us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.834182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.834202:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6391 00000100:00100000:3.0:1782487587.834219:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431488 00000100:00100000:3.0:1782487587.834222:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431488 00000100:00100000:0.0:1782487587.834271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.834277:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:3317:x1869066299279616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5327us (6300us total) trans 8589940794 rc 0/0 00000100:00100000:2.0:1782487587.834285:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16497 00010000:00010000:3.0:1782487587.834293:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 63 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834306:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.834313:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.834320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.834328:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.834332:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834341:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834356:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834365:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003504fefe/0x66475b4e8b85ea10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.834366:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+121:3317:x1869066299279744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5392us (6257us total) trans 8589940795 rc 0/0 00000100:00100000:3.0:1782487587.834374:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431744 00000100:00100000:3.0:1782487587.834379:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431744 00000100:00100000:0.0:1782487587.834381:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299282432:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.834385:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16498 00010000:00010000:2.0:1782487587.834393:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.834399:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 70 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834400:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.834402:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834409:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.834425:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.834427:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299282816:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.834430:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834445:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834452:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834457:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834472:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d716a1/0x66475b4e8b85ea17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834492:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.834494:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.834498:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.834498:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299282048:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.834517:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.834527:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299282560:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.834545:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.834556:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c6680/2, rc 0, transno 8589940795 00000100:00100000:1.0:1782487587.834568:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299279744:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.834583:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c6d80/2, rc 0, transno 8589940794 00000100:00100000:1.0:1782487587.834587:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299279616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.834594:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2361:x1869066294430848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 749us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.834603:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6392 00000100:00100000:3.0:1782487587.834638:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431360 00000100:00100000:2.0:1782487587.834642:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431616 00000100:00100000:3.0:1782487587.834643:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431360 00000100:00100000:2.0:1782487587.834647:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431616 00010000:00010000:3.0:1782487587.834664:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 72 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834668:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 72 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.834695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.834698:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294431872 00000100:00100000:2.0:1782487587.834702:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294431872 00000100:00100000:3.0:1782487587.834707:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432000 00000100:00100000:3.0:1782487587.834711:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432000 00010000:00010000:2.0:1782487587.834717:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 93 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834728:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 73 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.834738:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6393 00000100:00100000:2.0:1782487587.834749:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+93:2361:x1869066294431104:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.834759:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6394 00010000:00010000:2.0:1782487587.834759:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.834767:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 93 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.834775:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2361:x1869066294430976:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.834788:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 93 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834790:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.834799:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834809:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087013f8/0x66475b4e8b857c40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766d8 expref: 93 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834814:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834830:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.834835:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.834838:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d153abe0/0x66475b4e8b85a1e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1827:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771d6 expref: 63 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834841:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834858:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.834866:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1827:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.834867:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834872:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834884:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834895:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.834902:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834912:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834921:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.834923:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.834929:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+92:2361:x1869066294431104:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 181us (2161us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.834934:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834935:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.834941:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6393 00000100:00100000:3.0:1782487587.834948:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+62:2361:x1869066294430976:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 176us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.834961:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6395 00010000:00010000:0.0:1782487587.834961:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.834965:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.834977:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6394 00000100:00100000:2.0:1782487587.834977:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+91:2361:x1869066294431232:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.834979:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834989:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.834993:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.834997:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835001:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6396 00000100:00100000:3.0:1782487587.835016:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+61:2360:x1869066294431488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.835023:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835027:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.835028:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.835038:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835047:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2e5322/0x66475b4e8b857c47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766df expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835055:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835060:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.835069:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.835073:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835078:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3045a3b/0x66475b4e8b85a7f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773ab expref: 61 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835101:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835105:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.835113:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.835114:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+121:3315:x1869066299280640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4414us (4664us total) trans 8589940796 rc 0/0 00010000:00010000:3.0:1782487587.835118:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835118:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1782487587.835124:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16499 00010000:00010000:2.0:1782487587.835125:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835132:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835135:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.835141:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835144:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.835151:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835166:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835168:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.835172:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.835175:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835184:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835200:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835207:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93f4948/0x66475b4e8b85ea1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835208:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+60:2360:x1869066294431488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 196us (1091us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.835219:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835225:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6396 00000100:00100000:0.0:1782487587.835228:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+130:3315:x1869066299280512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4510us (4674us total) trans 8589940140 rc 0/0 00010000:00010000:1.0:1782487587.835234:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d76b21b/0x66475b4e8b85ea25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1827:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835236:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.835240:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.835242:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16500 00010000:00010000:2.0:1782487587.835244:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.835246:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6397 00000100:00100000:3.0:1782487587.835257:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2360:x1869066294431744:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.835264:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.835266:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.835267:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.835269:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299282944:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.835271:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.835274:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 73 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835288:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 73 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835289:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835314:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098c49bde/0x66475b4e8b85aa22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477476 expref: 73 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835326:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299283584:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.835327:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.835335:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.835339:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835347:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835351:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835362:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.835375:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835385:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835386:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1782487587.835389:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.835394:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835396:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299283712:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.835403:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835416:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:2360:x1869066294431744:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 160us (1268us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.835416:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.835433:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6397 00010000:00010000:1.0:1782487587.835447:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835452:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.835454:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835455:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6398 00000100:00100000:2.0:1782487587.835457:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299283584 00000100:00100000:2.0:1782487587.835462:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299283584 00000100:00100000:3.0:1782487587.835466:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2360:x1869066294431616:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.835475:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.835475:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.835480:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835491:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835492:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299283712 00000100:00100000:2.0:1782487587.835497:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299283712 00010000:00010000:3.0:1782487587.835508:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000555f405a/0x66475b4e8b85a53d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1829:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772c4 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835520:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1829:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.835525:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16511 00010000:00010000:3.0:1782487587.835527:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1829:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.835533:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835538:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+122:3314:x1869066299283584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.835550:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.835557:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6192 count 1 00010000:00010000:2.0:1782487587.835574:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835578:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.835589:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 90 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835597:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1830:0x0].0x0 since=4s v=(0 0) 00000100:00100000:3.0:1782487587.835603:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:2360:x1869066294431616:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (1330us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.835603:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.835648:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835657:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6398 00010000:00010000:2.0:1782487587.835675:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 90 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835679:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6399 00000100:00100000:3.0:1782487587.835695:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:2360:x1869066294431360:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.835696:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+131:3316:x1869066299281664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3396us (3630us total) trans 8589940141 rc 0/0 00010000:00010000:2.0:1782487587.835701:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 90 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835708:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.835713:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+131:3316:x1869066299281792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3381us (3566us total) trans 8589940142 rc 0/0 00000100:00100000:0.0:1782487587.835714:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16504 00010000:00010000:3.0:1782487587.835718:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835725:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299283840:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.835727:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506 00010000:00010000:3.0:1782487587.835736:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.835742:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16512 00010000:00010000:1.0:1782487587.835756:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1782487587.835758:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+122:3314:x1869066299283712:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.835759:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f83215d/0x66475b4e8b85a46b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1828:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47728c expref: 69 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835761:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.835763:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126c00 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.835773:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.835776:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.835778:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835779:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1828:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.835779:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1782487587.835780:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6194 count 1 00010000:00010000:3.0:1782487587.835785:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835788:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835793:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835797:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835804:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835815:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.835822:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835823:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835829:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 90 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835850:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.835852:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a07e516/0x66475b4e8b85ea41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.835853:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1832:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.835855:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.835862:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.835872:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835874:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835878:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+68:2360:x1869066294431360:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (1694us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.835880:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.835883:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.835886:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.835896:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6399 00010000:00010000:2.0:1782487587.835898:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c234de/0x66475b4e8b85ea4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.835906:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df5500/2, rc 0, transno 8589940142 00010000:00010000:0.0:1782487587.835911:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 90 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.835917:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6400 00010000:00010000:2.0:1782487587.835917:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.835919:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281792:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.835922:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.835926:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.835931:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2360:x1869066294431872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1782487587.835935:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb46eabed80/2, rc 0, transno 8589940141 00010000:00010000:0.0:1782487587.835937:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 90 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835940:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835941:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.835941:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb46eabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281664:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.835950:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 90 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.835967:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.835981:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 90 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.835990:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299283968:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.835991:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.835997:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299284096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.836005:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4dc30e/0x66475b4e8b857c4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4766e6 expref: 90 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836012:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836020:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.836024:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.836027:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.836028:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.836029:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.836035:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.836040:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.836063:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1782487587.836064:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.836072:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299284224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.836088:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+89:2360:x1869066294431872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.836095:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6400 00000100:00100000:1.0:1782487587.836099:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.836116:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6401 00000100:00100000:3.0:1782487587.836128:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2360:x1869066294432000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.836135:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299284096 00010000:00010000:3.0:1782487587.836136:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.836139:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299284096 00000100:00100000:0.0:1782487587.836139:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299284224 00010000:00010000:3.0:1782487587.836142:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 67 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.836144:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299284224 00010000:00010000:3.0:1782487587.836158:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 67 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.836168:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16513 00010000:00010000:3.0:1782487587.836172:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263d9ba8/0x66475b4e8b85aa29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47747d expref: 67 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.836176:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+132:3316:x1869066299284096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.836179:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16514 00010000:00010000:3.0:1782487587.836201:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182f:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.836201:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+132:3316:x1869066299284224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.836207:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6187 count 1 00010000:00010000:3.0:1782487587.836209:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.836214:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.836219:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6189 count 1 00010000:00010000:1.0:1782487587.836220:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.836223:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+132:3316:x1869066299281152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4375us (4621us total) trans 8589940143 rc 0/0 00010000:00010000:3.0:1782487587.836225:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.836232:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.836241:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16503 00010000:00010000:1.0:1782487587.836245:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 66 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836259:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487587.836260:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 66 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836264:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.836265:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.836272:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.836274:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.836274:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.836275:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.836283:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.836291:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.836297:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2360:x1869066294432000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (1604us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.836299:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb452642800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.836306:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836312:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 66 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.836315:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6401 00010000:00010000:0.0:1782487587.836324:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 66 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836326:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836333:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 65 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.836350:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 65 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.836352:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+59:2360:x1869066294430336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.836362:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299284352:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.836367:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.836374:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836376:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 59 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.836386:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299284480:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.836390:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.836399:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651c7290/0x66475b4e8b85ea3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1828:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836406:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 59 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836408:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.836414:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.836416:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.836418:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836420:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.836424:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.836425:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3878352/0x66475b4e8b85a0e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1824:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771a5 expref: 59 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836432:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836438:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.836438:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836440:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836442:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1824:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.836452:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836460:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.836461:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836465:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836478:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.836487:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836493:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.836505:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487587.836529:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+58:2360:x1869066294430336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 4896us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.836538:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6389 00010000:00010000:3.0:1782487587.836567:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836575:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836584:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836592:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.836625:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1782487587.836679:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb453dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+133:3315:x1869066299281920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4082us (4466us total) trans 8589940144 rc 0/0 00000100:00100000:1.0:1782487587.836688:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16507 00010000:00010000:1.0:1782487587.836720:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836729:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836738:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836746:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.836753:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4a1df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+132:3315:x1869066299281536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4429us (4652us total) trans 8589940145 rc 0/0 00000100:00100000:2.0:1782487587.836762:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505 00010000:00010000:1.0:1782487587.836765:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1782487587.836789:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1782487587.836830:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:3317:x1869066299278464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7949us (8902us total) trans 8589940797 rc 0/0 00000100:00100000:3.0:1782487587.836839:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16496 00000100:00100000:1.0:1782487587.836921:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+132:3317:x1869066299278976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8463us (9066us total) trans 8589940146 rc 0/0 00000100:00100000:1.0:1782487587.836929:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16495 00010000:00010000:1.0:1782487587.836950:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.836955:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836963:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb54834c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.836967:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836976:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836991:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.836999:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007635a9d7/0x66475b4e8b85ea48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1829:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837019:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.837023:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837031:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.837034:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837035:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837056:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8c800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.837059:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837061:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837083:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837085:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837101:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d2ba0ad/0x66475b4e8b85ea09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1826:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837104:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837116:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1fdd06/0x66475b4e8b85ea56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837119:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.837127:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837137:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8de00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.837142:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837142:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837146:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.837151:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837155:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837161:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837170:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837180:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075946bf0/0x66475b4e8b85ea02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1824:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.837199:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f6300/2, rc 0, transno 8589940144 00010000:00010000:1.0:1782487587.837210:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.837214:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299281920:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.837216:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837223:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837233:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.837248:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837257:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.837267:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e7100/2, rc 0, transno 8589940145 00010000:00010000:1.0:1782487587.837267:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.837280:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299281536:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.837290:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837307:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.837313:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.837319:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837328:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4baf8d200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.837333:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837342:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837356:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837365:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b16b92b/0x66475b4e8b85ea33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837385:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.837389:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.837392:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.837410:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299284608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.837443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.837471:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.837479:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299284736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.837488:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5589e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+123:3314:x1869066299281280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5665us (5908us total) trans 8589940798 rc 0/0 00000100:00100000:1.0:1782487587.837496:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16502 00000100:00100000:2.0:1782487587.837511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.837521:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299284608 00000100:00100000:1.0:1782487587.837526:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299284608 00000100:00100000:3.0:1782487587.837549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000004:00080000:2.0:1782487587.837551:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f4700/2, rc 0, transno 8589940798 00000100:00100000:1.0:1782487587.837559:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299284736 00000100:00100000:1.0:1782487587.837565:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299284736 00000100:00100000:2.0:1782487587.837566:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299281280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.837596:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16515 00000100:00100000:2.0:1782487587.837604:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16516 00000100:00100000:1.0:1782487587.837624:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+133:3314:x1869066299284608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.837638:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+133:3314:x1869066299284736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.837642:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6195 count 1 00002000:00080000:2.0:1782487587.837655:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6193 count 1 00010000:00010000:1.0:1782487587.837656:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.837662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.837670:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837671:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837689:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1833:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.837694:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1833:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.837696:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837699:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.837710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.837712:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1831:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.837717:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.837722:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.837740:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432128 00000100:00100000:3.0:1782487587.837744:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432128 00010000:00010000:1.0:1782487587.837744:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837748:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.837765:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 89 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.837765:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837768:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.837791:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299284864:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.837793:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299284992:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.837848:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.837849:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.837858:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432384 00000100:00100000:3.0:1782487587.837862:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432384 00010000:00010000:3.0:1782487587.837877:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 90 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.837899:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299283200:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.837901:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432256 00000100:00100000:3.0:1782487587.837904:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432256 00000100:00100000:2.0:1782487587.837913:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299283456:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.837917:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.837919:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 66 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.837931:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.837952:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d69500/2, rc 0, transno 8589940797 00000100:00100000:1.0:1782487587.837967:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299278464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.837979:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299283840:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.837988:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c5180/2, rc 0, transno 8589940146 00010000:00010000:2.0:1782487587.837999:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838002:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299278976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.838008:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6402 00000100:00100000:1.0:1782487587.838013:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782487587.838022:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+90:2361:x1869066294432128:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.838025:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299285120:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.838031:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.838037:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 90 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.838041:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c4000/2, rc 0, transno 8589940140 00000100:00100000:2.0:1782487587.838050:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299280512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.838057:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 90 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838057:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487587.838068:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c4380/2, rc 0, transno 8589940796 00010000:00010000:3.0:1782487587.838074:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f2755d/0x66475b4e8b858221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476875 expref: 90 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838075:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299280640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.838083:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285120 00000100:00100000:0.0:1782487587.838089:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285120 00000100:00100000:2.0:1782487587.838123:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16517 00000100:00100000:2.0:1782487587.838134:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+123:3317:x1869066299285120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.838149:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1833:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1782487587.838149:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6196 count 1 00010000:00010000:3.0:1782487587.838157:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1833:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.838162:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838165:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838179:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838197:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 90 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838204:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299285632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.838216:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1834:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.838221:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.838226:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838239:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.838250:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 90 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838262:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 90 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.838266:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299283968:192.168.202.21@tcp:104: 00000004:00080000:1.0:1782487587.838269:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f5500/2, rc 0, transno 8589940143 00000100:00100000:2.0:1782487587.838285:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299285760:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.838285:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299281152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.838286:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6403 00010000:00010000:0.0:1782487587.838290:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.838299:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+89:2361:x1869066294432384:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.838300:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.838310:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299285248:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.838311:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.838316:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 89 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838326:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126c00 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.838328:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 89 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838339:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.838344:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0ef1f4/0x66475b4e8b858260 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476883 expref: 89 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838348:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285632 00000100:00100000:2.0:1782487587.838353:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285632 00010000:00010000:3.0:1782487587.838355:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.838360:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.838364:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838373:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838381:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285248 00000100:00100000:2.0:1782487587.838385:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285248 00010000:00010000:3.0:1782487587.838402:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.838409:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299284352:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.838414:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16518 00000100:00100000:2.0:1782487587.838426:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+124:3316:x1869066299285632:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.838429:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.838437:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2361:x1869066294432384:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 141us (777us total) trans 0 rc 0/0 00002000:00080000:2.0:1782487587.838437:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6197 count 1 00000100:00100000:3.0:1782487587.838448:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6403 00000100:00100000:1.0:1782487587.838451:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299285888:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.838453:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838466:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 90 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.838472:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6404 00000100:00100000:1.0:1782487587.838481:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.838482:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1835:0x0].0x0 since=4s v=(0 0) 00000100:00100000:3.0:1782487587.838487:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2361:x1869066294432256:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.838488:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.838495:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838500:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.838508:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 66 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838518:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285888 00010000:00010000:2.0:1782487587.838519:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 90 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838522:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 66 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838522:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285888 00000100:00100000:1.0:1782487587.838553:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16519 00010000:00010000:2.0:1782487587.838555:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 90 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838556:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3aa8999/0x66475b4e8b85a544 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772cb expref: 66 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838562:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+135:3316:x1869066299285248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.838577:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6194 count 1 00000100:00100000:2.0:1782487587.838582:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299286016:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.838583:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.838590:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.838590:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838595:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838603:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.838603:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 65 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.838651:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1832:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.838654:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.838659:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838671:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126240 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.838681:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 65 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838698:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16520 00010000:00010000:1.0:1782487587.838699:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.838710:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+135:3317:x1869066299285888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.838715:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299286144:192.168.202.21@tcp:104: 00002000:00080000:2.0:1782487587.838725:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6196 count 1 00010000:00010000:3.0:1782487587.838732:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.838739:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838751:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 57 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.838755:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.838758:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe04850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+87:2361:x1869066294432128:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 738us (1209us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.838769:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=3s v=(0 0) 00000100:00100000:3.0:1782487587.838774:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6402 00010000:00010000:2.0:1782487587.838775:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.838783:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838806:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 57 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838817:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 57 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.838834:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.838837:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299286272:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.838839:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.838850:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.838859:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.838865:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2361:x1869066294432256:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 383us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.838867:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126e40 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.838868:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.838876:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6404 00010000:00010000:1.0:1782487587.838886:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.838889:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838899:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838909:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838917:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.838934:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.839084:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+136:3317:x1869066299283072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6028us (6117us total) trans 8589940147 rc 0/0 00000100:00100000:1.0:1782487587.839093:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16509 00000004:00080000:1.0:1782487587.839127:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f4000/2, rc 0, transno 8589940147 00000100:00100000:1.0:1782487587.839136:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299283072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.839146:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+125:3317:x1869066299283328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5604us (5679us total) trans 8589940799 rc 0/0 00000004:00080000:1.0:1782487587.839151:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd7b80/2, rc 0, transno 8589940799 00000100:00100000:2.0:1782487587.839156:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16510 00000100:00100000:1.0:1782487587.839163:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299283328:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.839184:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.839205:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839215:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.839220:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839230:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839244:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839252:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85ea64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839270:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.839274:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839281:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a480600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.839285:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839295:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839306:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839314:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c2f17de/0x66475b4e8b85ea6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839337:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.839340:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.839343:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.839351:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.839368:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839377:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839386:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839394:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.839413:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.839418:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.839425:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839433:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a481600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.839438:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.839446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.839446:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299284480:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.839447:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839466:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.839470:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839478:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df39f171/0x66475b4e8b85ea5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.839481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.839508:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.839512:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.839515:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.839569:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+125:3314:x1869066299282304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6821us (6901us total) trans 8589940800 rc 0/0 00000100:00100000:2.0:1782487587.839576:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16508 00000100:00100000:3.0:1782487587.839595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.839629:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299285504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.839661:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.839668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.839686:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285504 00000100:00100000:0.0:1782487587.839691:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285504 00000100:00100000:2.0:1782487587.839692:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299286528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.839718:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:213225:1869066299284864:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.839729:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16521 00000100:00100000:2.0:1782487587.839733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.839734:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.839743:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+125:3315:x1869066299285504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782487587.839759:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6190 count 1 00000100:00100000:1.0:1782487587.839764:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299286528 00000100:00100000:2.0:1782487587.839769:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299284992:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.839769:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299286528 00010000:00010000:0.0:1782487587.839772:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.839789:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 86 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.839791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.839791:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.839799:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522 00000100:00100000:1.0:1782487587.839811:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+126:3315:x1869066299286528:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.839818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.839818:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.839824:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182e:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.839826:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6198 count 1 00010000:00010000:0.0:1782487587.839829:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.839831:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299285376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.839839:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.839840:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432640 00000100:00100000:3.0:1782487587.839844:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432640 00010000:00010000:1.0:1782487587.839855:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 90 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839862:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1836:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1782487587.839866:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 87 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.839868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.839869:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.839869:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 87 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839877:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.839889:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299286400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.839891:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432512 00000100:00100000:3.0:1782487587.839896:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432512 00010000:00010000:0.0:1782487587.839903:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 88 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.839913:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 88 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.839914:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 90 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.839920:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299286656:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.839925:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.839936:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 90 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.839949:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299286784:192.168.202.21@tcp:104: 00000004:00080000:2.0:1782487587.839950:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb453dd0700/2, rc 0, transno 8589940800 00000100:00100000:2.0:1782487587.839961:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299282304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.839986:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.839986:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.839988:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299285376 00000100:00100000:2.0:1782487587.839994:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299285376 00000100:00100000:3.0:1782487587.840003:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432768 00000100:00100000:3.0:1782487587.840009:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432768 00000100:00100000:2.0:1782487587.840020:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299286400 00000100:00100000:2.0:1782487587.840024:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299286400 00000100:00100000:1.0:1782487587.840045:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16523 00000100:00100000:2.0:1782487587.840052:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16524 00000100:00100000:1.0:1782487587.840058:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+137:3314:x1869066299285376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.840066:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+137:3314:x1869066299286400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.840071:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6192 count 1 00002000:00080000:2.0:1782487587.840079:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6197 count 1 00010000:00010000:1.0:1782487587.840085:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840092:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 65 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840093:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.840098:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 65 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.840119:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1830:0x0].0x0 since=3s v=(0 0) 00000100:00100000:3.0:1782487587.840121:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294432896 00010000:00010000:2.0:1782487587.840123:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.840124:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294432896 00010000:00010000:1.0:1782487587.840124:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.840133:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.840140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1782487587.840142:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 66 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840142:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1835:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.840151:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.840161:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.840162:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 66 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.840166:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433024 00000100:00100000:3.0:1782487587.840171:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433024 00010000:00010000:1.0:1782487587.840199:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 67 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.840214:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299287040:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.840219:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840234:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.840245:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299287168:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.840254:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.840275:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.840280:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 67 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.840281:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299286144:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.840296:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.840321:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299285760:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.840322:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299286912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.840343:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.840359:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.840377:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:213223:1869066299286272:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.840394:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.840418:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299286912 00000100:00100000:2.0:1782487587.840421:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299286912 00000100:00100000:3.0:1782487587.840446:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433152 00000100:00100000:2.0:1782487587.840451:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525 00000100:00100000:3.0:1782487587.840452:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433152 00000100:00100000:2.0:1782487587.840461:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+127:3316:x1869066299286912:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.840473:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 68 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.840473:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6199 count 1 00010000:00010000:2.0:1782487587.840488:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.840493:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433280 00000100:00100000:3.0:1782487587.840498:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433280 00010000:00010000:2.0:1782487587.840511:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 91 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840514:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 91 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840528:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1837:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.840533:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.840538:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.840542:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6405 00000100:00100000:3.0:1782487587.840553:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2361:x1869066294432640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.840562:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.840564:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 91 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840569:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 88 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840582:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 91 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840588:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 88 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.840603:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299287296:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.840656:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2fbc015/0x66475b4e8b858298 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768b4 expref: 88 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840670:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.840673:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.840678:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840690:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.840729:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126e40 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.840760:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.840791:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc97050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+87:2361:x1869066294431232:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 5819us (7898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.840805:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6395 00000100:00100000:3.0:1782487587.840851:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6406 00000100:00100000:0.0:1782487587.840856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.840862:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6407 00000100:00100000:3.0:1782487587.840867:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2361:x1869066294432512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.840877:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+68:2361:x1869066294432768:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.840878:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.840889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.840890:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.840897:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 68 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840910:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 68 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.840922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.840932:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1c07d2/0x66475b4e8b85aa6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774b5 expref: 68 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840943:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.840947:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.840951:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840955:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 86 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840965:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840975:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 86 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.840991:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b86d6c45/0x66475b4e8b85827c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4768ad expref: 86 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.840992:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.841001:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.841004:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1830:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.841008:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299286656:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.841009:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.841011:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.841016:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841020:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294432768:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 145us (1422us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.841029:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.841030:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.841033:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841038:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6407 00010000:00010000:1.0:1782487587.841051:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841053:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433408 00000100:00100000:2.0:1782487587.841058:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433408 00010000:00010000:1.0:1782487587.841071:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.841072:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.841076:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 67 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841094:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433536 00000100:00100000:2.0:1782487587.841097:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433536 00010000:00010000:2.0:1782487587.841112:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 92 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841130:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433664 00000100:00100000:2.0:1782487587.841133:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433664 00010000:00010000:2.0:1782487587.841148:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 58 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841167:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6408 00000100:00100000:2.0:1782487587.841176:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2360:x1869066294432896:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.841197:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.841204:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 67 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841216:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 67 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841232:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14cc485/0x66475b4e8b85aa5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x182d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477484 expref: 67 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841243:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.841246:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x182d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.841251:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841259:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.841271:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+138:3316:x1869066299284096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5095us (5236us total) trans 8589940148 rc 0/0 00000100:00100000:1.0:1782487587.841279:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16513 00010000:00010000:2.0:1782487587.841283:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.841291:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.841301:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841302:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.841311:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2360:x1869066294432896:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (1642us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.841312:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841330:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6408 00010000:00010000:0.0:1782487587.841335:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841337:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.841345:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.841347:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841351:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6409 00000100:00100000:2.0:1782487587.841363:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2360:x1869066294433024:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.841371:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841375:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.841380:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.841385:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841409:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841410:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841429:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85ea80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841435:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff1637da/0x66475b4e8b85b168 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1833:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477660 expref: 65 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841452:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1833:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.841454:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.841456:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1833:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.841459:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841462:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841478:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.841482:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841484:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841510:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.841524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.841526:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841533:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064241c79/0x66475b4e8b85ea87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841535:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299287168:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.841537:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+138:3316:x1869066299284224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5345us (5433us total) trans 8589940149 rc 0/0 00000100:00100000:3.0:1782487587.841549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.841554:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.841559:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16514 00010000:00010000:1.0:1782487587.841561:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.841566:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.841569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.841571:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.841587:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.841592:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.841597:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299286784:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.841598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.841628:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.841634:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841640:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841652:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.841668:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.841673:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299287040:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.841691:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.841720:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433792 00000100:00100000:3.0:1782487587.841724:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433792 00000004:00080000:1.0:1782487587.841725:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f7100/2, rc 0, transno 8589940149 00000100:00100000:1.0:1782487587.841735:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299284224:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.841744:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 86 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.841751:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f5f80/2, rc 0, transno 8589940148 00000100:00100000:1.0:1782487587.841756:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299284096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.841761:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294433920 00000100:00100000:3.0:1782487587.841764:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294433920 00010000:00010000:3.0:1782487587.841780:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 93 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.841795:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434176 00000100:00100000:3.0:1782487587.841798:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434176 00010000:00010000:3.0:1782487587.841814:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 59 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.841829:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434048 00000100:00100000:3.0:1782487587.841832:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434048 00000100:00100000:1.0:1782487587.841832:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299287424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.841847:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.841858:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+128:3314:x1869066299283584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6323us (6499us total) trans 8589940801 rc 0/0 00000100:00100000:1.0:1782487587.841868:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.841871:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16511 00000100:00100000:2.0:1782487587.841890:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299287424 00000100:00100000:2.0:1782487587.841893:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299287424 00000100:00100000:2.0:1782487587.841921:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526 00000100:00100000:3.0:1782487587.841931:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6410 00000100:00100000:2.0:1782487587.841931:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+138:3317:x1869066299287424:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.841947:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2361:x1869066294433152:12345-192.168.202.21@tcp:103:ldlm_bl.0 00002000:00080000:2.0:1782487587.841950:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6198 count 1 00010000:00010000:3.0:1782487587.841959:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.841966:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.841967:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.841980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.841992:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 59 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.841995:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842011:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1836:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.842016:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.842021:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842022:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097c21759/0x66475b4e8b85b17d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1831:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477667 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842042:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 59 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842053:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 59 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.842069:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299287680:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.842074:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.842078:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1831:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.842082:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842090:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842120:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.842129:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842140:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.842145:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+64:2361:x1869066294433152:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 200us (2325us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.842158:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.842159:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6410 00010000:00010000:2.0:1782487587.842170:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.842177:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434304 00000100:00100000:3.0:1782487587.842182:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434304 00010000:00010000:2.0:1782487587.842199:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.842348:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+139:3314:x1869066299284736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4715us (4839us total) trans 8589940150 rc 0/0 00000100:00100000:2.0:1782487587.842355:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16516 00000100:00100000:2.0:1782487587.842380:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.842391:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.842396:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842404:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.842409:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842418:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842432:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842441:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ddd8ab/0x66475b4e8b85ea72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842457:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 94 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842465:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.842470:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.842479:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6411 00010000:00010000:2.0:1782487587.842479:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb57fc71000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.842485:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.842493:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+94:2361:x1869066294433280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.842497:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842509:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842517:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457a2dbe/0x66475b4e8b85ea95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1831:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842530:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.842532:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.842536:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.842543:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.842554:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.842561:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 94 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.842569:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299286016:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.842577:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 94 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842587:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842594:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba787430/0x66475b4e8b8585b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769da expref: 94 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842648:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842657:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842667:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842675:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842693:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.842697:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.842702:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842702:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.842708:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.842714:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842714:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842723:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb45a49de00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.842728:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842737:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842755:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842762:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3f6d8ca/0x66475b4e8b85ea2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.842781:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.842784:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.842787:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2361:x1869066294432512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1925us (3308us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.842788:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.842794:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6406 00000100:00100000:3.0:1782487587.842811:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6412 00000100:00100000:3.0:1782487587.842821:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+63:2361:x1869066294433408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.842830:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.842836:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842846:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842860:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000381170ff/0x66475b4e8b85b184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1832:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47767c expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842870:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1832:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.842873:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1832:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.842888:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+128:3316:x1869066299280768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11567us (11797us total) trans 8589940802 rc 0/0 00000100:00100000:2.0:1782487587.842897:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16501 00000004:00080000:1.0:1782487587.842903:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f7480/2, rc 0, transno 8589940802 00000100:00100000:1.0:1782487587.842917:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299280768:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.842934:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.842937:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299287680:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.842950:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.842959:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.842978:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.842983:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.842988:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299287808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.842999:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.843008:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.843011:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+62:2361:x1869066294433408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 193us (2162us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.843016:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.843020:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6412 00000100:00100000:2.0:1782487587.843022:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.843037:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.843042:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6413 00000100:00100000:3.0:1782487587.843052:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+93:2361:x1869066294433536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.843053:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1782487587.843057:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782487587.843063:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299287552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.843063:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843064:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.843075:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 93 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843078:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.843085:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843095:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843097:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.843112:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843125:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add8bde8/0x66475b4e8b85eaaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843130:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299287808 00010000:00010000:3.0:1782487587.843131:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 93 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843135:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299287808 00010000:00010000:0.0:1782487587.843138:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.843142:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.843146:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.843154:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678c4d55/0x66475b4e8b8585a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4769d3 expref: 93 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843163:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299287552 00000100:00100000:2.0:1782487587.843167:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299287552 00010000:00010000:3.0:1782487587.843168:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843173:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843178:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843185:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843209:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16527 00000100:00100000:1.0:1782487587.843214:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+140:3316:x1869066299285248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4652us (4872us total) trans 8589940151 rc 0/0 00000100:00100000:0.0:1782487587.843220:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16528 00000100:00100000:2.0:1782487587.843222:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+128:3315:x1869066299287808:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.843229:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.843229:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16519 00000100:00100000:0.0:1782487587.843234:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+140:3315:x1869066299287552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.843238:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6201 count 1 00010000:00010000:2.0:1782487587.843251:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.843251:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6199 count 1 00000100:00100000:3.0:1782487587.843257:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+92:2361:x1869066294433536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 205us (2368us total) trans 0 rc 0/0 00000004:00080000:1.0:1782487587.843261:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfe680/2, rc 0, transno 8589940151 00010000:00010000:0.0:1782487587.843268:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843272:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299285248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.843273:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6413 00010000:00010000:2.0:1782487587.843275:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 92 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843294:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1839:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1782487587.843298:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 59 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843299:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.843306:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843309:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782487587.843315:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1837:0x0].0x0 since=3s v=(0 0) 00000100:00100000:1.0:1782487587.843322:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299287936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.843324:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.843331:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843339:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 91 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843347:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.843352:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 91 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843353:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.843360:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 59 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843371:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299288064:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.843372:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+85:2361:x1869066294432640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 2816us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.843379:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299287936 00010000:00010000:0.0:1782487587.843381:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 59 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843383:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299287936 00000100:00100000:3.0:1782487587.843392:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6405 00000100:00100000:0.0:1782487587.843409:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299288192:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.843410:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529 00000100:00100000:3.0:1782487587.843412:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6414 00000100:00100000:2.0:1782487587.843422:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.843423:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+59:2362:x1869066294433664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.843423:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+140:3317:x1869066299287936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.843435:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1782487587.843436:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6200 count 1 00010000:00010000:2.0:1782487587.843440:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843441:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 59 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.843445:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45af67480 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.843448:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843461:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843466:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843470:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 59 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.843471:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 59 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843472:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843494:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.843496:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1782487587.843497:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843504:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fddbce7a/0x66475b4e8b85b37c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1834:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47776a expref: 59 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.843505:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.843515:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843517:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843525:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843531:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843540:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1834:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843549:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843549:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.843551:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 58 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843560:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.843564:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 58 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843569:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843576:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299288320:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.843589:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.843628:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+58:2362:x1869066294433664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 208us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.843632:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.843634:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6414 00000100:00100000:3.0:1782487587.843653:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6415 00000100:00100000:3.0:1782487587.843662:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2361:x1869066294433792:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.843671:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.843676:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 84 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843688:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 84 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843701:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006787aeae/0x66475b4e8b858275 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x182e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47689f expref: 84 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843712:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843715:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x182e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843719:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843731:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843751:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.843772:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+83:2361:x1869066294433792:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 112us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.843778:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6415 00000100:00100000:0.0:1782487587.843794:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+130:3314:x1869066299283712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8041us (8369us total) trans 8589940803 rc 0/0 00000100:00100000:3.0:1782487587.843796:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6416 00000100:00100000:0.0:1782487587.843804:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16512 00000100:00100000:3.0:1782487587.843808:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fc96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+91:2361:x1869066294433920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.843817:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.843825:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.843825:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+129:3316:x1869066299285632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5398us (5582us total) trans 8589940804 rc 0/0 00000004:00080000:1.0:1782487587.843829:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfce00/2, rc 0, transno 8589940804 00000100:00100000:2.0:1782487587.843842:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16518 00000100:00100000:1.0:1782487587.843842:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299285632:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.843847:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843863:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fecfead/0x66475b4e8b858618 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476a2e expref: 91 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843867:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.843875:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843877:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.843887:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.843891:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.843893:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843896:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299288448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.843897:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843900:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843922:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843924:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843928:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.843937:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.843949:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.843959:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.843970:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.843972:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85eaa3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.843974:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.843984:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fc96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+90:2361:x1869066294433920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 177us (2436us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.843993:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844001:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6416 00010000:00010000:2.0:1782487587.844003:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.844003:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844007:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844010:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844021:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6417 00010000:00010000:2.0:1782487587.844032:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.844032:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844034:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+57:2361:x1869066294434176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.844034:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.844040:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844046:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.844055:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844057:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844059:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.844082:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844084:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844105:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818b1b84/0x66475b4e8b85ea79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1832:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844114:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da07421/0x66475b4e8b85b383 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1835:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477771 expref: 57 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844124:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487587.844127:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.844129:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844132:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1835:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.844143:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844144:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.844150:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844169:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844172:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844199:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844208:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664d5ba6/0x66475b4e8b85eab8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x182e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.844209:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+129:3315:x1869066299285504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4469us (4547us total) trans 8589940805 rc 0/0 00010000:00010000:3.0:1782487587.844211:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.844228:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16521 00000100:00100000:3.0:1782487587.844234:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+56:2361:x1869066294434176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 202us (2664us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.844234:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.844240:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.844246:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299288448 00000100:00100000:3.0:1782487587.844248:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6417 00000100:00100000:1.0:1782487587.844252:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+129:3315:x1869066299286528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4442us (4524us total) trans 8589940806 rc 0/0 00000100:00100000:0.0:1782487587.844254:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299288448 00010000:00010000:2.0:1782487587.844258:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.844264:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.844265:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522 00000100:00100000:3.0:1782487587.844270:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6418 00010000:00010000:2.0:1782487587.844280:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844285:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+61:2363:x1869066294434048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487587.844287:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530 00000100:00100000:1.0:1782487587.844297:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+129:3317:x1869066299288448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.844299:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.844300:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844306:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.844310:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6202 count 1 00010000:00010000:2.0:1782487587.844316:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85eabf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844323:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844325:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844334:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844334:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.844338:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.844339:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 89 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844342:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27e3615/0x66475b4e8b85b176 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1830:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477675 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844343:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844344:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.844350:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183a:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1782487587.844354:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.844355:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.844358:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1830:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.844358:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844362:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844363:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487587.844372:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdffb80/2, rc 0, transno 8589940805 00010000:00010000:1.0:1782487587.844382:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 89 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844386:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.844389:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299285504:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.844402:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844405:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 89 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844406:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487587.844409:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfd880/2, rc 0, transno 8589940806 00000100:00100000:0.0:1782487587.844420:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299286528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.844421:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.844433:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.844433:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299288576:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.844447:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+60:2363:x1869066294434048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.844454:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6418 00000100:00100000:1.0:1782487587.844470:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.844473:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.844479:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.844486:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844496:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.844501:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844511:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6419 00010000:00010000:0.0:1782487587.844520:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844525:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2361:x1869066294434304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.844526:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844537:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.844541:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844543:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 89 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844544:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844563:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 89 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844567:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844570:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b0c57bc/0x66475b4e8b85eab1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844581:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.844581:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844588:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.844592:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.844600:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.844600:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.844602:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.844635:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.844651:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+141:3317:x1869066299285888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5898us (6126us total) trans 8589940152 rc 0/0 00010000:00010000:0.0:1782487587.844655:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.844663:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.844668:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16520 00010000:00010000:3.0:1782487587.844674:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.844679:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844690:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844695:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844704:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+89:2361:x1869066294434304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 179us (2725us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.844704:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844709:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85eac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1830:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.844725:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6419 00010000:00010000:2.0:1782487587.844745:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.844755:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844757:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844761:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.844765:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844766:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.844770:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+141:3314:x1869066299285376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4714us (4902us total) trans 8589940153 rc 0/0 00000100:00100000:1.0:1782487587.844785:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16523 00010000:00010000:2.0:1782487587.844788:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.844797:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.844803:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844812:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.844816:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.844821:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfdf80/2, rc 0, transno 8589940152 00010000:00010000:0.0:1782487587.844827:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.844833:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299285888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.844844:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844855:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85eacd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1835:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.844875:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844879:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.844883:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.844888:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299288960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.844922:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+141:3314:x1869066299286400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4860us (5000us total) trans 8589940154 rc 0/0 00000100:00100000:1.0:1782487587.844931:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.844935:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16524 00000100:00100000:2.0:1782487587.844953:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299288960 00000100:00100000:2.0:1782487587.844956:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299288960 00000100:00100000:1.0:1782487587.844988:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16531 00000100:00100000:1.0:1782487587.844998:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+141:3316:x1869066299288960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.845012:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6201 count 1 00010000:00010000:2.0:1782487587.845024:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a822a1c/0x66475b4e8b858895 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476b1c expref: 88 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845026:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.845047:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299287296:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.845050:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845059:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.845063:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.845068:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845069:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845091:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845107:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845107:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.845112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.845131:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845133:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.845142:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434432 00000100:00100000:3.0:1782487587.845146:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434432 00010000:00010000:2.0:1782487587.845149:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845156:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299289088:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.845164:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 56 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845165:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.845204:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6420 00000100:00100000:1.0:1782487587.845224:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.845245:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.845250:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845259:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.845264:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845272:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.845283:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+56:2360:x1869066294434432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.845286:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.845293:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.845299:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 56 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845299:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ead4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.845313:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 56 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845323:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.845327:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5215139/0x66475b4e8b85b6af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1836:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47783c expref: 56 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845327:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.845331:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.845338:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.845341:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1836:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.845346:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.845354:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.845361:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+130:3316:x1869066299286912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4900us (5002us total) trans 8589940807 rc 0/0 00000100:00100000:2.0:1782487587.845370:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525 00000004:00080000:1.0:1782487587.845370:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdff100/2, rc 0, transno 8589940807 00010000:00010000:3.0:1782487587.845376:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.845383:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299286912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.845395:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.845408:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.845410:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+55:2360:x1869066294434432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 197us (300us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.845427:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.845428:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6420 00000100:00100000:1.0:1782487587.845428:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299289216:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.845442:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845451:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845467:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.845480:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.845484:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.845488:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845497:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.845500:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845506:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845507:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299289216 00000100:00100000:1.0:1782487587.845513:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299289216 00010000:00010000:0.0:1782487587.845522:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845532:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85eadb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1836:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845547:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16532 00010000:00010000:0.0:1782487587.845552:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.845556:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.845557:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+130:3317:x1869066299289216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.845560:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782487587.845573:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6203 count 1 00010000:00010000:1.0:1782487587.845588:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845601:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 82 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845628:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.845631:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.845636:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845648:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.845650:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+142:3317:x1869066299287424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3721us (3784us total) trans 8589940155 rc 0/0 00000100:00100000:2.0:1782487587.845659:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526 00010000:00010000:1.0:1782487587.845664:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 82 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845676:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 82 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845681:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2361:x1869066294433280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 3188us (5543us total) trans 0 rc 0/0 00000004:00080000:2.0:1782487587.845687:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfca80/2, rc 0, transno 8589940155 00000100:00100000:1.0:1782487587.845698:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299289344:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.845702:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6411 00000100:00100000:2.0:1782487587.845703:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299287424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.845749:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845750:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.845756:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299288704:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.845767:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845777:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.845788:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299288832:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.845792:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845806:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299288704 00000100:00100000:0.0:1782487587.845809:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299288704 00010000:00010000:2.0:1782487587.845810:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.845822:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782487587.845827:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.845829:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845833:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16533 00010000:00010000:2.0:1782487587.845843:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.845843:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+131:3314:x1869066299288704:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.845849:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845856:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299288832 00002000:00080000:0.0:1782487587.845856:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6200 count 1 00010000:00010000:2.0:1782487587.845861:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845863:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299288832 00010000:00010000:0.0:1782487587.845868:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845877:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845879:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845892:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534 00010000:00010000:0.0:1782487587.845900:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1838:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782487587.845901:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85ea9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1834:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.845906:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+132:3315:x1869066299288832:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.845906:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.845915:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845926:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782487587.845926:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6204 count 1 00010000:00010000:2.0:1782487587.845930:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.845934:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.845935:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.845942:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.845943:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845968:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299289600:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.845971:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 82 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.845980:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.845984:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.845988:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.845996:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5483fcf00 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.846011:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 82 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846018:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299289472:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.846026:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 82 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846038:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299289728:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.846068:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.846085:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+133:3317:x1869066299285120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7952us (8029us total) trans 8589940808 rc 0/0 00000100:00100000:2.0:1782487587.846093:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16517 00000004:00080000:2.0:1782487587.846127:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e6a00/2, rc 0, transno 8589940808 00000100:00100000:2.0:1782487587.846137:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299285120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.846204:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299288064:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.846220:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.846242:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299289856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.846269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.846297:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299288192:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.846314:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299289856 00010000:00010000:0.0:1782487587.846316:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.846318:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299289856 00000100:00100000:2.0:1782487587.846349:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16535 00000100:00100000:1.0:1782487587.846349:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299288320:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.846362:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+133:3315:x1869066299289856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.846367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.846368:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1782487587.846377:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6205 count 1 00010000:00010000:2.0:1782487587.846393:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846399:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299289472 00000100:00100000:1.0:1782487587.846404:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299289472 00010000:00010000:2.0:1782487587.846407:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 82 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487587.846413:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfe300/2, rc 0, transno 8589940153 00010000:00010000:2.0:1782487587.846417:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.846421:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.846425:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299285376:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.846427:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846435:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16536 00000004:00080000:0.0:1782487587.846438:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfd180/2, rc 0, transno 8589940154 00000100:00100000:0.0:1782487587.846446:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299286400:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.846450:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+142:3314:x1869066299289472:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1782487587.846457:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd5880/2, rc 0, transno 8589940150 00010000:00010000:2.0:1782487587.846458:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 82 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846464:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299284736:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.846466:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6202 count 1 00000004:00080000:0.0:1782487587.846478:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f5c00/2, rc 0, transno 8589940803 00010000:00010000:2.0:1782487587.846479:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 82 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.846486:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846487:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299283712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.846499:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299289984:192.168.202.21@tcp:104: 00000004:00080000:0.0:1782487587.846501:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f7b80/2, rc 0, transno 8589940801 00010000:00010000:1.0:1782487587.846508:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 59 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846511:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299283584:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.846523:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=2s v=(0 0) 00000100:00100000:2.0:1782487587.846527:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126d80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.846527:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.846535:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846540:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434688 00000100:00100000:0.0:1782487587.846545:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434688 00010000:00010000:1.0:1782487587.846558:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 59 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.846559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.846564:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 87 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.846574:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846581:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434560 00000100:00100000:0.0:1782487587.846585:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434560 00000100:00100000:1.0:1782487587.846589:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299290240:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.846596:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 55 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.846633:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6421 00000100:00100000:0.0:1782487587.846641:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+87:2361:x1869066294434688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.846650:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.846654:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 87 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846662:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 87 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.846671:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299290368:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.846678:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003441495b/0x66475b4e8b858b4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476baf expref: 87 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846679:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.846693:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.846697:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1839:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.846704:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.846705:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846707:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299290112:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.846721:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.846735:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299290368 00000100:00100000:2.0:1782487587.846739:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299290368 00010000:00010000:0.0:1782487587.846745:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.846747:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.846772:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299290112 00000100:00100000:0.0:1782487587.846773:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2361:x1869066294434688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 131us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.846776:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299290112 00000100:00100000:1.0:1782487587.846778:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299290752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.846789:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6421 00000100:00100000:2.0:1782487587.846804:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537 00000100:00100000:1.0:1782487587.846810:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.846814:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6422 00000100:00100000:2.0:1782487587.846816:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+144:3317:x1869066299290368:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.846825:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+55:2360:x1869066294434560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00002000:00080000:2.0:1782487587.846829:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6203 count 1 00010000:00010000:0.0:1782487587.846833:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.846839:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 55 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.846842:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846851:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299290752 00010000:00010000:0.0:1782487587.846851:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 55 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846857:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299290752 00010000:00010000:2.0:1782487587.846859:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 59 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846868:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74ad137/0x66475b4e8b85b6bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1837:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47784a expref: 55 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.846874:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 55 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846880:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1837:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.846885:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487587.846885:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1837:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.846890:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16538 00010000:00010000:2.0:1782487587.846894:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.846895:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.846901:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.846903:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+144:3316:x1869066299290112:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.846910:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.846923:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6204 count 1 00010000:00010000:0.0:1782487587.846935:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.846939:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.846941:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 54 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846947:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.846967:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 54 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846968:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.846971:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 59 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.846993:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.846998:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299290880:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.847014:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.847021:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.847021:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847029:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847037:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.847043:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 59 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847056:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 59 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847057:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 59 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847084:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299291008:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.847084:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 59 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847103:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299291136:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.847112:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.847131:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299290624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.847135:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.847144:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+145:3315:x1869066299287552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3913us (4048us total) trans 8589940156 rc 0/0 00010000:00010000:1.0:1782487587.847150:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.847151:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16528 00010000:00010000:1.0:1782487587.847155:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.847166:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.847170:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16539 00010000:00010000:1.0:1782487587.847172:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.847178:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+134:3316:x1869066299290752:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.847181:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782487587.847202:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6207 count 1 00000004:00080000:2.0:1782487587.847205:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfd500/2, rc 0, transno 8589940156 00010000:00010000:1.0:1782487587.847211:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847213:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847216:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299287552:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.847233:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af32c560/0x66475b4e8b85eae9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1837:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847237:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847252:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.847256:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.847256:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183f:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.847258:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782487587.847261:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.847261:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847264:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.847267:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299290496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.847276:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.847285:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299291264:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.847298:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847306:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.847314:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847321:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299290624 00000100:00100000:1.0:1782487587.847325:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299290624 00000100:00100000:0.0:1782487587.847325:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299291392:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.847336:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299290496 00000100:00100000:2.0:1782487587.847341:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299290496 00000100:00100000:1.0:1782487587.847348:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16540 00000100:00100000:1.0:1782487587.847356:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+135:3315:x1869066299290624:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.847356:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.847368:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16541 00002000:00080000:1.0:1782487587.847368:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6206 count 1 00000100:00100000:2.0:1782487587.847379:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+145:3315:x1869066299290496:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.847381:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847394:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.847395:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6212 count 1 00010000:00010000:1.0:1782487587.847405:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.847409:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.847411:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847415:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847431:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 54 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847446:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.847446:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847452:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847453:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.847462:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847470:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847479:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847497:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 54 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847501:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847504:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299291520:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.847518:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 54 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847519:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847542:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299291648:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.847543:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.847548:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.847563:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.847576:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.847603:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299291264 00000100:00100000:1.0:1782487587.847624:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299291264 00010000:00010000:2.0:1782487587.847648:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.847654:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847663:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.847667:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847676:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847681:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299288576:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.847702:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.847704:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847718:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eae2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847738:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16542 00010000:00010000:2.0:1782487587.847739:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.847742:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.847745:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.847752:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+146:3316:x1869066299291264:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.847758:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+136:3315:x1869066299287808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4536us (4736us total) trans 8589940809 rc 0/0 00000100:00100000:0.0:1782487587.847768:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16527 00002000:00080000:1.0:1782487587.847770:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6211 count 1 00000004:00080000:2.0:1782487587.847775:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdff480/2, rc 0, transno 8589940809 00010000:00010000:1.0:1782487587.847783:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847786:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299287808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.847803:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 54 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.847812:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2360:x1869066294434560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 989us (1253us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.847828:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=2s v=(0 0) 00000100:00100000:0.0:1782487587.847832:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6422 00010000:00010000:1.0:1782487587.847834:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.847838:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299291776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.847840:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.847865:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.847870:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 53 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.847871:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.847885:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 53 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.847891:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+59:2360:x1869066294433024:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 6528us (8101us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.847901:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299291776 00000100:00100000:2.0:1782487587.847907:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299291776 00000100:00100000:1.0:1782487587.847908:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299291904:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.847916:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6409 00000100:00100000:2.0:1782487587.847932:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16543 00000100:00100000:2.0:1782487587.847943:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+136:3314:x1869066299291776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.847955:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6208 count 1 00000100:00100000:1.0:1782487587.847955:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.847970:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.847983:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.847988:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299289088:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.847996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.847999:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1840:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.848003:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.848008:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848009:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.848041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.848041:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848043:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848063:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.848063:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434944 00010000:00010000:2.0:1782487587.848065:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.848068:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434944 00000100:00100000:3.0:1782487587.848084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.848089:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.848094:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299292032:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.848097:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848114:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.848125:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.848125:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435072 00000100:00100000:0.0:1782487587.848133:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435072 00010000:00010000:1.0:1782487587.848134:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.848143:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.848148:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848154:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.848157:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294434816 00010000:00010000:0.0:1782487587.848157:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.848163:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294434816 00010000:00010000:0.0:1782487587.848165:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848174:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848179:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ea8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1833:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848182:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 54 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848204:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.848208:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.848211:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.848218:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6423 00000100:00100000:2.0:1782487587.848228:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2360:x1869066294434944:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.848230:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848240:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.848247:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.848253:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6424 00010000:00010000:2.0:1782487587.848267:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.848267:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2363:x1869066294434816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.848280:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.848287:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 54 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848299:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ea998d/0x66475b4e8b858b51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bc4 expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848301:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 54 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.848304:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+147:3314:x1869066299284608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10698us (10859us total) trans 8589940157 rc 0/0 00000100:00100000:1.0:1782487587.848323:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16515 00010000:00010000:2.0:1782487587.848329:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.848332:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c139ed6a/0x66475b4e8b85b6c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477851 expref: 54 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848334:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.848343:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848348:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.848354:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848355:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.848366:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848376:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848379:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.848400:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe04c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2360:x1869066294434944:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 174us (408us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.848402:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.848410:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6423 00000100:00100000:0.0:1782487587.848430:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2363:x1869066294434816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.848437:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6424 00000100:00100000:1.0:1782487587.848448:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299289344:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.848453:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6425 00000100:00100000:2.0:1782487587.848465:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+59:2361:x1869066294435072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.848470:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848473:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.848484:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848498:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848502:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848529:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848537:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b55f9ff/0x66475b4e8b85ba3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1839:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477923 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848541:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.848547:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299289600:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.848554:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.848562:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1839:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.848565:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.848566:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848568:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848593:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848603:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.848675:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.848691:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848700:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848710:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848719:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.848734:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.848827:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+137:3317:x1869066299288448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4530us (4891us total) trans 8589940810 rc 0/0 00000100:00100000:1.0:1782487587.848835:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530 00000100:00100000:1.0:1782487587.848871:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299289728:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.848886:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848902:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.848906:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848911:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.848914:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848920:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848930:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848935:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85eaf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.848956:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+147:3316:x1869066299288960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3958us (4027us total) trans 8589940158 rc 0/0 00010000:00010000:1.0:1782487587.848956:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.848961:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.848969:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16531 00010000:00010000:1.0:1782487587.848970:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.848975:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848980:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848988:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.848993:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85eafe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1839:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849010:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.849012:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.849016:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.849018:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f5180/2, rc 0, transno 8589940810 00010000:00010000:1.0:1782487587.849029:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.849030:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299288448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.849042:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849051:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849055:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849067:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782487587.849098:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd4380/2, rc 0, transno 8589940157 00000100:00100000:2.0:1782487587.849109:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299284608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.849116:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.849156:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.849165:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299292288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.849220:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+147:3317:x1869066299287936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5800us (5866us total) trans 8589940159 rc 0/0 00000100:00100000:1.0:1782487587.849226:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529 00010000:00010000:1.0:1782487587.849245:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.849248:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849254:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.849257:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.849265:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.849268:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849280:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849285:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eaf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849303:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.849306:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfc000/2, rc 0, transno 8589940159 00010000:00010000:1.0:1782487587.849306:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.849311:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.849319:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299287936:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782487587.849336:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3ca80/2, rc 0, transno 8589940158 00000100:00100000:1.0:1782487587.849342:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299288960:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.849361:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.849372:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.849380:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299292416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.849400:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299292288 00000100:00100000:1.0:1782487587.849405:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.849406:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299292288 00000100:00100000:2.0:1782487587.849438:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299292416 00000100:00100000:2.0:1782487587.849442:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299292416 00000100:00100000:1.0:1782487587.849447:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16544 00000100:00100000:1.0:1782487587.849456:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+148:3317:x1869066299292288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.849467:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6207 count 1 00000100:00100000:2.0:1782487587.849469:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545 00010000:00010000:1.0:1782487587.849478:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.849480:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+148:3316:x1869066299292416:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.849496:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 58 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.849499:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6209 count 1 00010000:00010000:1.0:1782487587.849506:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.849508:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.849511:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849515:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.849527:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 58 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849531:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 58 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849553:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.849556:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 58 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849558:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.849567:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.849571:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299292672:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.849600:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 58 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849631:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 58 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.849638:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.849643:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299292800:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.849672:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.849685:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487587.849695:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299292160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.849698:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299292544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.849731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.849771:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+58:2361:x1869066294435072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1307us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.849775:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299292160 00000100:00100000:2.0:1782487587.849780:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299292160 00000100:00100000:3.0:1782487587.849783:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6425 00000100:00100000:2.0:1782487587.849814:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546 00000100:00100000:2.0:1782487587.849824:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+137:3314:x1869066299292160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.849836:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6213 count 1 00010000:00010000:2.0:1782487587.849849:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849862:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849870:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.849874:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.849879:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849897:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.849908:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.849919:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299292928:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.849950:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.849974:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.849999:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299292544 00000100:00100000:2.0:1782487587.850002:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299292544 00000100:00100000:2.0:1782487587.850031:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547 00000100:00100000:2.0:1782487587.850039:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+149:3315:x1869066299292544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.850052:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6208 count 1 00010000:00010000:2.0:1782487587.850064:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.850076:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 57 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.850084:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.850088:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.850092:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.850113:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 57 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.850124:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 57 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.850134:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299293056:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.850156:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.850998:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299289984:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.851010:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299290240:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.851018:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.851031:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.851057:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299290880:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.851071:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299291136:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.851078:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:200304:1869066299291008:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.851086:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851105:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299291392:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.851106:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.851116:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299291520:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.851121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851124:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.851134:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.851145:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435200 00000100:00100000:0.0:1782487587.851149:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435200 00000100:00100000:3.0:1782487587.851168:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851168:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 83 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851203:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435456 00000100:00100000:3.0:1782487587.851204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.851208:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435456 00010000:00010000:0.0:1782487587.851222:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 84 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.851241:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435712 00000100:00100000:0.0:1782487587.851244:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435712 00010000:00010000:0.0:1782487587.851256:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 53 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.851276:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435968 00000100:00100000:3.0:1782487587.851279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.851281:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435968 00000100:00100000:3.0:1782487587.851296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851300:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 58 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851319:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435328 00000100:00100000:0.0:1782487587.851321:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435328 00000100:00100000:3.0:1782487587.851333:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851336:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 85 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851353:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435584 00000100:00100000:0.0:1782487587.851356:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435584 00000100:00100000:2.0:1782487587.851358:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299292032:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.851374:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.851380:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851393:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294435840 00000100:00100000:0.0:1782487587.851398:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294435840 00000100:00100000:1.0:1782487587.851400:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299291904:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.851403:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.851411:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:213384:1869066299291648:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.851415:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 60 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.851416:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851428:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.851429:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851445:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436096 00000100:00100000:0.0:1782487587.851448:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436096 00000100:00100000:3.0:1782487587.851455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851460:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 86 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851474:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436352 00000100:00100000:0.0:1782487587.851476:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436352 00000100:00100000:3.0:1782487587.851480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.851489:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 85 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851496:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436480 00000100:00100000:3.0:1782487587.851501:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436480 00000100:00100000:0.0:1782487587.851507:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436736 00000100:00100000:0.0:1782487587.851512:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436736 00010000:00010000:3.0:1782487587.851523:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 87 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851530:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 54 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851541:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436224 00000100:00100000:3.0:1782487587.851545:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436224 00000100:00100000:0.0:1782487587.851552:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436608 00000100:00100000:0.0:1782487587.851556:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436608 00010000:00010000:3.0:1782487587.851559:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 88 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851571:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 55 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.851578:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6426 00000100:00100000:3.0:1782487587.851588:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2360:x1869066294435200:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.851593:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6427 00010000:00010000:3.0:1782487587.851596:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487587.851603:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+88:2360:x1869066294435456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.851624:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.851629:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 88 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851637:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 88 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851650:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafaadda/0x66475b4e8b858fbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cea expref: 88 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851659:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.851662:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.851666:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851672:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851695:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.851712:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.851723:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851729:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+87:2360:x1869066294435456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (584us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.851736:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851739:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6427 00010000:00010000:2.0:1782487587.851749:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851758:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6428 00010000:00010000:2.0:1782487587.851767:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.851767:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+55:2360:x1869066294435712:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.851777:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 88 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851777:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.851785:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851801:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851812:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d76eb8/0x66475b4e8b85c18a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b5a expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851821:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.851837:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2360:x1869066294435712:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 73us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.851843:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6428 00000100:00100000:0.0:1782487587.851857:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6429 00000100:00100000:0.0:1782487587.851864:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+60:2360:x1869066294435968:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.851871:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.851876:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 60 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851887:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 60 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851902:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f4152e5/0x66475b4e8b85ba60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47793f expref: 60 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851913:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.851916:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.851920:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851927:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.851950:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.851956:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.851969:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.851969:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+59:2360:x1869066294435968:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.851983:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6429 00010000:00010000:1.0:1782487587.851986:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.851996:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.852002:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6430 00010000:00010000:3.0:1782487587.852006:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 86 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852016:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.852017:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+86:2360:x1869066294435328:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.852026:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be59d4d0/0x66475b4e8b858fc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cf8 expref: 86 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852029:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.852035:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+138:3315:x1869066299289856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5674us (5764us total) trans 8589940811 rc 0/0 00010000:00010000:0.0:1782487587.852039:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 86 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.852052:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16535 00010000:00010000:3.0:1782487587.852060:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.852065:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 85 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.852066:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.852075:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852077:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.852085:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852086:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009436a006/0x66475b4e8b858ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476cce expref: 85 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.852092:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852109:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.852116:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852118:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.852127:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.852137:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852141:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.852152:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+150:3316:x1869066299290112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5250us (5404us total) trans 8589940160 rc 0/0 00010000:00010000:0.0:1782487587.852153:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852163:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.852169:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16538 00010000:00010000:2.0:1782487587.852180:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85eb1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852204:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.852207:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.852211:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.852214:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852215:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.852218:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.852226:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.852231:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852239:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.852240:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd5f80/2, rc 0, transno 8589940811 00000100:00100000:2.0:1782487587.852252:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299289856:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.852257:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852267:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9cbf43/0x66475b4e8b85eb2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852286:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.852289:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1782487587.852290:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.852295:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.852301:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299293184:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.852321:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e5180/2, rc 0, transno 8589940160 00000100:00100000:1.0:1782487587.852334:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299290112:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.852349:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852358:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852365:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852372:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852385:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.852517:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+84:2360:x1869066294435328:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 504us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.852526:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.852529:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6430 00000100:00100000:1.0:1782487587.852535:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+138:3315:x1869066299288832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6631us (6710us total) trans 8589940812 rc 0/0 00000100:00100000:1.0:1782487587.852545:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534 00000100:00100000:0.0:1782487587.852552:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6431 00000100:00100000:2.0:1782487587.852556:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299293184 00000100:00100000:2.0:1782487587.852561:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299293184 00000100:00100000:0.0:1782487587.852564:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+58:2360:x1869066294435584:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.852571:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.852573:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.852577:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852579:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 58 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.852590:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548 00000100:00100000:2.0:1782487587.852601:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+138:3314:x1869066299293184:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.852602:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.852604:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 58 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852644:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.852646:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6209 count 1 00010000:00010000:0.0:1782487587.852653:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa55a78c/0x66475b4e8b85ba4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477931 expref: 58 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852661:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852661:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852667:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.852677:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.852689:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852692:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852697:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 83 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852709:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852718:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eb13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852720:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1841:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.852728:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.852737:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852748:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.852749:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.852752:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.852757:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.852761:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 83 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.852764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.852768:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.852776:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+57:2360:x1869066294435584:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 212us (1516us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.852782:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 83 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852786:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.852797:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6431 00000100:00100000:3.0:1782487587.852803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.852810:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.852815:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299293312:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.852817:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436864 00000100:00100000:0.0:1782487587.852823:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436864 00010000:00010000:1.0:1782487587.852832:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.852844:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 57 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.852846:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.852866:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126600 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.852866:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294436992 00000100:00100000:0.0:1782487587.852872:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294436992 00010000:00010000:0.0:1782487587.852888:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 58 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.852897:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299292928:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.852909:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6432 00010000:00010000:2.0:1782487587.852915:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.852922:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+58:2360:x1869066294435840:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.852934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.852937:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.852945:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 58 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.852953:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299293056:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.852960:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 58 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.852968:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.852973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.852980:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1931711/0x66475b4e8b85bca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e7 expref: 58 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.852986:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+150:3314:x1869066299289472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6538us (6612us total) trans 8589940161 rc 0/0 00000100:00100000:1.0:1782487587.853003:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16536 00010000:00010000:3.0:1782487587.853004:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.853007:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.853012:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.853016:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.853020:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3f100/2, rc 0, transno 8589940812 00010000:00010000:0.0:1782487587.853022:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853028:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853031:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+83:2360:x1869066294435200:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1445us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.853034:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299288832:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.853040:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.853043:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853045:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6426 00010000:00010000:1.0:1782487587.853052:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853059:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.853064:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+57:2360:x1869066294435840:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 145us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.853078:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6432 00000100:00100000:2.0:1782487587.853085:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782487587.853086:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.853094:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437120 00000100:00100000:2.0:1782487587.853096:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299293440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.853098:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437120 00010000:00010000:0.0:1782487587.853116:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853123:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437248 00000100:00100000:3.0:1782487587.853129:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437248 00000100:00100000:0.0:1782487587.853131:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6433 00000100:00100000:2.0:1782487587.853138:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.853142:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+82:2360:x1869066294436096:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.853148:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 57 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853150:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.853158:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853167:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853169:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299293440 00000100:00100000:2.0:1782487587.853174:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299293440 00000100:00100000:3.0:1782487587.853176:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6434 00010000:00010000:0.0:1782487587.853182:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c57adb7d/0x66475b4e8b85904b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d22 expref: 82 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853202:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2360:x1869066294436352:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.853205:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.853208:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.853211:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.853212:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853220:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853221:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853248:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853254:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549 00010000:00010000:0.0:1782487587.853256:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.853261:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+140:3317:x1869066299289216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7705us (7796us total) trans 8589940813 rc 0/0 00000100:00100000:2.0:1782487587.853268:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+140:3317:x1869066299293440:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.853270:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fb3cc64/0x66475b4e8b858b43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1838:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476bb6 expref: 86 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.853274:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16532 00010000:00010000:0.0:1782487587.853275:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.853284:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6211 count 1 00010000:00010000:0.0:1782487587.853294:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853299:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853303:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.853307:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487587.853309:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853312:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1838:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.853314:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853323:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853327:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 81 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853337:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.853338:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853343:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853345:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853352:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1843:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.853360:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.853369:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853370:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853376:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782487587.853382:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.853398:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853406:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e291fc/0x66475b4e8b85eb21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853409:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 81 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853410:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2360:x1869066294436352:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 222us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.853426:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6434 00010000:00010000:2.0:1782487587.853431:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 81 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853433:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.853441:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853451:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299293568:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.853453:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.853460:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853463:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6435 00010000:00010000:1.0:1782487587.853468:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853474:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+81:2361:x1869066294436480:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.853480:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853483:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.853488:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eb05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853491:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 81 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853495:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb559126f00 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.853508:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.853511:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 81 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853512:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853519:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ee00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.853523:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.853526:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3c000/2, rc 0, transno 8589940813 00010000:00010000:3.0:1782487587.853527:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8494c77/0x66475b4e8b8594e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476e8e expref: 81 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853536:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853541:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1840:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.853542:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299289216:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.853545:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.853548:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.853550:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+140:3316:x1869066299290752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6371us (6738us total) trans 8589940814 rc 0/0 00010000:00010000:3.0:1782487587.853553:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853563:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d76b21b/0x66475b4e8b85eb36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.853565:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16539 00010000:00010000:3.0:1782487587.853567:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853585:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.853587:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299293696:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.853590:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.853592:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853595:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.853601:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853625:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853634:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.853638:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5600db100/2, rc 0, transno 8589940814 00010000:00010000:0.0:1782487587.853647:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.853648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.853653:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299290752:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.853667:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.853687:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.853692:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853696:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+80:2361:x1869066294436480:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 224us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.853696:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299293696 00000100:00100000:2.0:1782487587.853702:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299293696 00010000:00010000:1.0:1782487587.853703:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3f000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.853706:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6435 00010000:00010000:1.0:1782487587.853708:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853716:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853727:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853736:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550 00010000:00010000:1.0:1782487587.853738:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a07e516/0x66475b4e8b85eb0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1838:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853748:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+140:3317:x1869066299293696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.853754:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6436 00010000:00010000:1.0:1782487587.853757:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.853760:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.853762:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.853765:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2361:x1869066294436736:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.853769:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1782487587.853771:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6210 count 1 00010000:00010000:3.0:1782487587.853776:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.853784:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 53 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853786:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853800:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.853801:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+141:3314:x1869066299288704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7957us (8015us total) trans 8589940815 rc 0/0 00010000:00010000:2.0:1782487587.853816:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 79 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.853816:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16533 00010000:00010000:3.0:1782487587.853825:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 53 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853831:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1842:0x0].0x0 since=3s v=(0 0) 00000100:00100000:1.0:1782487587.853839:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299292672:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.853840:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1842:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.853843:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6437 00010000:00010000:3.0:1782487587.853850:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000decfc18d/0x66475b4e8b85c240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b99 expref: 53 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853851:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.853857:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fe05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+79:2362:x1869066294436224:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.853858:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853872:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.853878:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.853881:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 79 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853882:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.853894:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853894:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 79 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853902:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 79 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.853920:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853936:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d243e4/0x66475b4e8b859044 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476d1b expref: 79 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.853940:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 79 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.853948:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.853952:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x183e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.853953:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299294080:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.853956:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.853958:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853960:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.853984:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.853986:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+52:2361:x1869066294436736:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (2560us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.853986:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.853994:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb5591260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.853999:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6436 00010000:00010000:1.0:1782487587.854003:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854010:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854014:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854016:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.854026:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854028:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.854038:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fe05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2362:x1869066294436224:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 184us (2584us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.854042:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.854047:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6437 00010000:00010000:2.0:1782487587.854056:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.854065:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6438 00010000:00010000:2.0:1782487587.854071:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.854072:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6439 00000100:00100000:3.0:1782487587.854078:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+51:2361:x1869066294436608:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.854084:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+57:2360:x1869066294436864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.854086:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.854092:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.854095:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 51 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854099:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 57 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854119:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 57 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854126:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 51 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854132:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d222959/0x66475b4e8b85c1de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b76 expref: 57 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854142:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.854144:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.854147:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cc7006/0x66475b4e8b85c40e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c1e expref: 51 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854148:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854171:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854172:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.854182:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.854200:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854207:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.854209:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.854211:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+150:3316:x1869066299291264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6462us (6647us total) trans 8589940162 rc 0/0 00000100:00100000:1.0:1782487587.854219:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16542 00000100:00100000:0.0:1782487587.854231:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+56:2360:x1869066294436864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (1472us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.854236:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.854239:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6439 00010000:00010000:2.0:1782487587.854248:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.854253:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549182680/2, rc 0, transno 8589940162 00000100:00100000:0.0:1782487587.854257:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6440 00010000:00010000:2.0:1782487587.854263:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.854267:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299291264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.854271:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+55:2360:x1869066294436992:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.854285:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2361:x1869066294436608:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 209us (2803us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.854285:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782487587.854288:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.854292:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854296:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854299:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 55 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.854300:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6438 00010000:00010000:1.0:1782487587.854307:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.854314:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854321:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854330:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 55 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.854334:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6441 00010000:00010000:1.0:1782487587.854339:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.854346:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2360:x1869066294437120:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.854352:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.854358:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.854359:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.854363:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854364:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.854368:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854372:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854377:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85eb4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854394:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854399:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854404:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.854409:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854424:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f77d2844/0x66475b4e8b859a1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47700f expref: 84 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854436:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.854437:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.854442:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.854444:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:3.0:1782487587.854447:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854448:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.854455:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854456:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854468:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.854475:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+55:2360:x1869066294436992:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 205us (1672us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.854479:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85eb52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.854485:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+150:3315:x1869066299290496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7105us (7179us total) trans 8589940163 rc 0/0 00000100:00100000:0.0:1782487587.854487:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6440 00010000:00010000:3.0:1782487587.854499:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.854503:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16541 00000100:00100000:0.0:1782487587.854514:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6442 00010000:00010000:1.0:1782487587.854521:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.854525:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+54:2361:x1869066294437248:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.854527:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2360:x1869066294437120:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 182us (1597us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.854528:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854530:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854532:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.854541:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 54 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.854543:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6441 00010000:00010000:1.0:1782487587.854549:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.854556:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854557:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854562:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 54 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854582:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854584:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854588:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000233b281f/0x66475b4e8b85c1b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1840:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b6f expref: 54 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854602:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854635:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.854638:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1840:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.854641:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854647:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854661:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854673:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.854683:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85eb44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.854697:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.854705:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.854710:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854717:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.854721:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.854728:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2361:x1869066294437248:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 205us (1758us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.854731:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.854737:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6442 00010000:00010000:1.0:1782487587.854750:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.854758:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85eb67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.854771:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2360:x1869066294436096:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1633us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.854777:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6433 00010000:00010000:1.0:1782487587.854781:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.854784:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.854787:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.854795:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.854801:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.854816:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+141:3314:x1869066299292160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4993us (5085us total) trans 8589940816 rc 0/0 00000100:00100000:2.0:1782487587.854830:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546 00000100:00100000:1.0:1782487587.854851:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299294208:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.854858:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854868:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854879:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.854888:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.854893:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.854908:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.854931:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299294208 00000100:00100000:1.0:1782487587.854936:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299294208 00000100:00100000:1.0:1782487587.854971:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16551 00000100:00100000:1.0:1782487587.854981:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+150:3316:x1869066299294208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487587.854997:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6205 count 1 00010000:00010000:1.0:1782487587.855012:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855026:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 52 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855035:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 52 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855043:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.855048:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.855052:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 5/0,1 mode: --/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.855062:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+151:3315:x1869066299292544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5022us (5085us total) trans 8589940164 rc 0/0 00000100:00100000:2.0:1782487587.855070:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547 00010000:00010000:1.0:1782487587.855080:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 52 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855092:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 52 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.855104:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299294336:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.855169:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 52 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855181:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 52 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.855203:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299294464:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.855210:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+141:3314:x1869066299291776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7267us (7336us total) trans 8589940817 rc 0/0 00000100:00100000:2.0:1782487587.855218:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16543 00000100:00100000:1.0:1782487587.855237:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.855247:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855257:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.855259:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855264:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855288:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855289:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.855296:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855301:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855316:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855323:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.855332:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855342:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85eb6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1840:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855363:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.855367:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855374:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.855378:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855388:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855402:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855410:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001498ff11/0x66475b4e8b85eb28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855437:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855441:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855446:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855454:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855462:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855475:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.855483:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb559179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+151:3317:x1869066299290368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8670us (8781us total) trans 8589940165 rc 0/0 00010000:00010000:1.0:1782487587.855488:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.855494:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537 00010000:00010000:1.0:1782487587.855504:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855512:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855528:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782487587.855531:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df4700/2, rc 0, transno 8589940165 00000100:00100000:2.0:1782487587.855543:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299290368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.855594:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299294592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.855650:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.855693:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299294592 00000100:00100000:2.0:1782487587.855696:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299294592 00000100:00100000:2.0:1782487587.855729:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1782487587.855740:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:3317:x1869066299294592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.855741:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+141:3315:x1869066299290624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8382us (8575us total) trans 8589940818 rc 0/0 00000100:00100000:1.0:1782487587.855753:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16540 00002000:00080000:2.0:1782487587.855756:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6210 count 1 00010000:00010000:2.0:1782487587.855770:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855783:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 52 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855789:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.855796:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855807:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 52 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855807:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.855813:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855823:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.855826:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855828:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.855837:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855845:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855855:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85eb3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855858:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 52 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855879:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 52 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855885:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855889:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.855892:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299294720:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.855894:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.855913:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855922:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855930:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855938:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.855958:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.855973:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 52 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.855986:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 52 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.855998:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299294848:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.856025:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d240 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.856053:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d90000/2, rc 0, transno 8589940164 00000100:00100000:2.0:1782487587.856065:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299292544:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.856103:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5600d9500/2, rc 0, transno 8589940163 00000100:00100000:2.0:1782487587.856112:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299290496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.856137:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+152:3317:x1869066299292288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6681us (6874us total) trans 8589940166 rc 0/0 00000100:00100000:1.0:1782487587.856147:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16544 00000004:00080000:2.0:1782487587.856156:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d90a80/2, rc 0, transno 8589940166 00000100:00100000:2.0:1782487587.856166:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299292288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.856172:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.856179:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856198:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.856202:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856213:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856227:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782487587.856227:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856239:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299295232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.856239:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4caed6b/0x66475b4e8b85eb59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856264:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.856268:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.856272:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.856273:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.856297:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299295232 00000100:00100000:0.0:1782487587.856303:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299295232 00000004:00080000:2.0:1782487587.856317:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5600d9880/2, rc 0, transno 8589940818 00000100:00100000:2.0:1782487587.856339:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5600d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299290624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.856345:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553 00000100:00100000:2.0:1782487587.856354:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299293952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.856360:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+152:3317:x1869066299295232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782487587.856376:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6215 count 1 00000100:00100000:2.0:1782487587.856386:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.856392:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.856396:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.856410:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299293952 00000100:00100000:1.0:1782487587.856411:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299295360:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.856412:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 49 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856415:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299293952 00010000:00010000:0.0:1782487587.856426:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487587.856430:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.856435:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856443:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554 00000100:00100000:2.0:1782487587.856456:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+141:3315:x1869066299293952:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.856456:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.856464:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 49 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.856472:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6212 count 1 00000100:00100000:1.0:1782487587.856488:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299295360 00010000:00010000:2.0:1782487587.856489:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.856490:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 49 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.856492:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299295360 00000100:00100000:1.0:1782487587.856515:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555 00010000:00010000:2.0:1782487587.856516:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 76 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.856518:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299295488:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.856525:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+142:3316:x1869066299295360:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.856535:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1844:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.856539:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1844:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1782487587.856540:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6215 count 1 00010000:00010000:2.0:1782487587.856544:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856551:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.856561:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb45adb4d80 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.856566:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 82 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856567:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 76 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856591:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.856593:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 76 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856597:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.856624:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856637:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299295616:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.856653:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 82 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.856666:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 82 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.856679:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299295744:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.856691:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb55898d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.856713:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.856736:0:190928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045d5b621/0x66475b4e8b85c1bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b7d expref: 52 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.856749:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299292800:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.856765:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856775:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856783:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856798:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856806:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856823:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.856835:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.856840:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856848:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.856852:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856861:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856875:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856883:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85eb60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.856900:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.856903:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.856905:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.856916:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299295104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.856942:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.856964:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782487587.856970:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299293824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.856992:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.857015:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299295104 00000100:00100000:2.0:1782487587.857018:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299295104 00000100:00100000:2.0:1782487587.857040:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299293824 00000100:00100000:2.0:1782487587.857043:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299293824 00000100:00100000:2.0:1782487587.857060:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556 00000100:00100000:2.0:1782487587.857068:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+154:3315:x1869066299295104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.857080:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6214 count 1 00010000:00010000:2.0:1782487587.857092:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857105:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 49 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857113:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.857116:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.857121:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857140:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 49 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857157:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.857168:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299295872:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.857257:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.857277:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557 00000100:00100000:2.0:1782487587.857286:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+154:3315:x1869066299293824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.857299:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6206 count 1 00010000:00010000:2.0:1782487587.857311:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857323:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 51 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857333:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 51 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857340:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.857343:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.857347:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857365:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 51 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857381:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 51 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.857392:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299296000:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.857422:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 51 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.857433:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 51 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.857445:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299296128:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.857467:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84c00 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.857500:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d93100/2, rc 0, transno 8589940816 00000100:00100000:2.0:1782487587.857511:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299292160:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.857548:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d92a00/2, rc 0, transno 8589940817 00000100:00100000:2.0:1782487587.857556:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299291776:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.857589:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3d880/2, rc 0, transno 8589940815 00000100:00100000:2.0:1782487587.857598:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299288704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.857654:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.857662:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299296512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.857689:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.857713:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299296512 00000100:00100000:1.0:1782487587.857718:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299296512 00000100:00100000:1.0:1782487587.857753:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558 00000100:00100000:1.0:1782487587.857762:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+143:3317:x1869066299296512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.857777:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6216 count 1 00010000:00010000:1.0:1782487587.857790:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.857803:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 82 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.857810:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1848:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.857814:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.857818:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.857841:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 82 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.857852:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 82 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.857863:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299296640:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.857904:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.857919:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+155:3316:x1869066299292416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8440us (8513us total) trans 8589940167 rc 0/0 00000100:00100000:2.0:1782487587.857929:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545 00000004:00080000:1.0:1782487587.857940:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d93480/2, rc 0, transno 8589940167 00000100:00100000:1.0:1782487587.857955:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299292416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.858015:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.858027:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5589e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299296768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.858062:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.858066:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299294976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.858095:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.858106:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299296768 00000100:00100000:1.0:1782487587.858111:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299296768 00000100:00100000:2.0:1782487587.858124:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299296384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.858143:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299294976 00000100:00100000:1.0:1782487587.858148:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299294976 00000100:00100000:2.0:1782487587.858149:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.858177:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299296384 00000100:00100000:2.0:1782487587.858179:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.858182:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299296384 00000100:00100000:1.0:1782487587.858220:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16559 00000100:00100000:1.0:1782487587.858228:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+156:3316:x1869066299296768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.858235:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299296256:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.858242:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6216 count 1 00010000:00010000:1.0:1782487587.858258:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858266:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.858278:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 49 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.858286:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.858290:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.858295:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858300:0:200304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299296256 00000100:00100000:2.0:1782487587.858304:0:200304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299296256 00010000:00010000:1.0:1782487587.858321:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 49 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.858332:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 49 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858342:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16560 00000100:00100000:1.0:1782487587.858347:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299296896:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.858353:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:3315:x1869066299294976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.858368:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6213 count 1 00010000:00010000:2.0:1782487587.858381:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.858390:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.858395:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 49 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.858404:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.858408:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.858413:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.858419:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16561 00000100:00100000:1.0:1782487587.858434:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+145:3315:x1869066299296384:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.858439:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 49 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.858452:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6218 count 1 00010000:00010000:2.0:1782487587.858458:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 49 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.858469:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858472:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299297024:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.858489:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.858498:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184a:0x0].0x0 since=3s v=(0 0) 00000100:00100000:2.0:1782487587.858502:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84600 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.858502:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.858510:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858524:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16562 00000100:00100000:2.0:1782487587.858538:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+145:3315:x1869066299296256:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.858538:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.858552:0:200304:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6214 count 1 00010000:00010000:1.0:1782487587.858555:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.858565:0:200304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.858570:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299297152:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.858587:0:200304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 82 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.858596:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1846:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.858600:0:200304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.858638:0:200304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.858660:0:200304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 82 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.858672:0:200304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 82 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.858684:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.858692:0:200304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299297280:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.858719:0:200304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.858751:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:213226:1869066299293568:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.858769:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.858813:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d69f80/2, rc 0, transno 8589940161 00000100:00100000:2.0:1782487587.858830:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299289472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.858868:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299293312:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.858886:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.858897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.858923:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299294080:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.858938:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.858957:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299297408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.858985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.859027:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299297408 00000100:00100000:2.0:1782487587.859031:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299297408 00000100:00100000:2.0:1782487587.859062:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16563 00000100:00100000:2.0:1782487587.859071:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:3314:x1869066299297408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487587.859083:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6217 count 1 00010000:00010000:2.0:1782487587.859095:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859108:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 49 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859116:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.859120:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.859124:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.859140:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.859146:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 49 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859158:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 49 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.859172:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299297536:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.859177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.859210:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437376 00000100:00100000:0.0:1782487587.859215:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437376 00000100:00100000:2.0:1782487587.859218:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84780 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.859235:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 77 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859256:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437632 00000100:00100000:0.0:1782487587.859258:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437632 00010000:00010000:0.0:1782487587.859268:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 78 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859288:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437504 00000100:00100000:0.0:1782487587.859292:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437504 00010000:00010000:0.0:1782487587.859305:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 79 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859325:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6443 00000100:00100000:0.0:1782487587.859331:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+79:2360:x1869066294437376:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.859339:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.859343:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 79 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859353:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 79 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859371:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d86c130/0x66475b4e8b859506 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1841:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb1 expref: 79 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859384:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.859388:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1841:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.859393:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859401:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859426:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.859448:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859456:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+78:2360:x1869066294437376:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 122us (561us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.859465:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859469:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6443 00010000:00010000:2.0:1782487587.859485:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859490:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6444 00010000:00010000:2.0:1782487587.859499:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.859503:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2363:x1869066294437632:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.859510:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6445 00010000:00010000:0.0:1782487587.859517:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.859523:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.859529:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+77:2361:x1869066294437504:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.859530:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.859535:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.859542:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859545:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.859546:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859554:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859560:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.859566:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859575:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859576:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078b87481/0x66475b4e8b85950d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476eb8 expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859578:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 77 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859599:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859601:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.859622:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c715ca4/0x66475b4e8b85951b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1843:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476ecd expref: 76 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859626:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ef004a/0x66475b4e8b85eb75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1841:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859634:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.859637:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.859641:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859642:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1843:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.859645:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.859650:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.859653:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.859656:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859657:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.859677:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.859691:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.859700:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.859733:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:2361:x1869066294437504:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.859733:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+75:2363:x1869066294437632:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 229us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.859746:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+146:3314:x1869066299293184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7144us (7219us total) trans 8589940819 rc 0/0 00000100:00100000:0.0:1782487587.859752:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6444 00000100:00100000:2.0:1782487587.859762:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548 00000100:00100000:3.0:1782487587.859763:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6445 00010000:00010000:2.0:1782487587.859794:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859804:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859813:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859822:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.859887:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.859894:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.859901:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859909:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.859914:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859923:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859937:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859945:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85eb83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.859971:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.859974:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.859978:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.860037:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+146:3317:x1869066299293696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6292us (6388us total) trans 8589940820 rc 0/0 00000100:00100000:2.0:1782487587.860048:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550 00000004:00080000:2.0:1782487587.860082:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d92d80/2, rc 0, transno 8589940820 00000100:00100000:2.0:1782487587.860091:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299293696:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.860135:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.860144:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.860153:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.860162:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.860180:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.860195:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.860202:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860211:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.860216:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860225:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860239:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860254:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85eb7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1843:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860274:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.860277:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.860280:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.860342:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+146:3317:x1869066299293440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7076us (7204us total) trans 8589940821 rc 0/0 00000100:00100000:2.0:1782487587.860349:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549 00000004:00080000:2.0:1782487587.860384:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d92680/2, rc 0, transno 8589940821 00000100:00100000:2.0:1782487587.860393:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299293440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.860442:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb559179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299297792:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.860470:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d91880/2, rc 0, transno 8589940819 00000100:00100000:1.0:1782487587.860472:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.860484:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299293184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.860492:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.860515:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299297792 00000100:00100000:1.0:1782487587.860519:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299297792 00000100:00100000:2.0:1782487587.860537:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299297920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.860543:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16564 00000100:00100000:1.0:1782487587.860550:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+146:3316:x1869066299297792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.860562:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6220 count 1 00000100:00100000:2.0:1782487587.860569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.860572:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860583:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 82 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860588:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.860590:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.860593:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.860625:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299297664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.860651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.860683:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299297920 00010000:00010000:1.0:1782487587.860687:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 82 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.860688:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299297920 00010000:00010000:1.0:1782487587.860703:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 82 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.860713:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299297664 00000100:00100000:1.0:1782487587.860715:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299298048:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.860717:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299297664 00000100:00100000:2.0:1782487587.860743:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16565 00000100:00100000:2.0:1782487587.860752:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+148:3317:x1869066299297920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.860763:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6219 count 1 00010000:00010000:2.0:1782487587.860776:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.860778:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.860792:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 82 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.860800:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.860803:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.860808:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.860816:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16566 00000100:00100000:1.0:1782487587.860828:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+148:3314:x1869066299297664:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.860834:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 82 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.860844:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6217 count 1 00010000:00010000:2.0:1782487587.860846:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 82 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860857:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.860868:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299298176:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.860875:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 82 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860885:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1849:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.860889:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.860893:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860916:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 82 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.860927:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 82 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.860942:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.860946:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299298304:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.860977:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.863594:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299294336:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.863803:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299294464:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.863829:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.863841:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299294720:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.863867:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299295872:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.863889:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.863902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.863902:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:195192:1869066299295488:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.863927:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299294848:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.863927:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.863956:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.863964:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437888 00000100:00100000:0.0:1782487587.863969:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437888 00000100:00100000:1.0:1782487587.863971:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299295744:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.863973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.863984:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299295616:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.863988:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.863997:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 52 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.864000:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864043:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438272 00000100:00100000:3.0:1782487587.864044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864049:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438272 00000100:00100000:2.0:1782487587.864053:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299296000:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.864070:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 74 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864102:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294437760 00000100:00100000:0.0:1782487587.864106:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294437760 00000100:00100000:3.0:1782487587.864117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.864123:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 53 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.864131:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299296128:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.864139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864146:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438144 00000100:00100000:0.0:1782487587.864150:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438144 00010000:00010000:2.0:1782487587.864158:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.864168:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 50 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864205:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438528 00000100:00100000:0.0:1782487587.864209:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438528 00000100:00100000:1.0:1782487587.864217:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299296640:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.864218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.864225:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 51 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.864230:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864250:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438016 00000100:00100000:0.0:1782487587.864254:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438016 00010000:00010000:0.0:1782487587.864269:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 54 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.864272:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299296896:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.864275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.864286:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864291:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438400 00000100:00100000:0.0:1782487587.864296:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438400 00010000:00010000:0.0:1782487587.864312:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 55 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864338:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438656 00000100:00100000:0.0:1782487587.864342:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438656 00000100:00100000:2.0:1782487587.864344:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299297024:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.864360:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 83 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.864364:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.864366:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299297152:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.864384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.864388:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864391:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438912 00000100:00100000:0.0:1782487587.864396:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438912 00000100:00100000:2.0:1782487587.864411:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:190928:1869066299297536:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.864416:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 56 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.864432:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864438:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294438784 00000100:00100000:0.0:1782487587.864443:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294438784 00010000:00010000:0.0:1782487587.864460:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 57 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.864469:0:200304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:200304:1869066299297280:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.864473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.864485:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439040 00010000:00010000:2.0:1782487587.864490:0:200304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864490:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439040 00000100:00100000:3.0:1782487587.864502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.864508:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 84 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864528:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439168 00000100:00100000:0.0:1782487587.864531:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439168 00010000:00010000:0.0:1782487587.864544:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 52 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864560:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439424 00000100:00100000:0.0:1782487587.864561:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439424 00010000:00010000:0.0:1782487587.864570:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 53 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864584:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439552 00000100:00100000:3.0:1782487587.864585:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439296 00000100:00100000:0.0:1782487587.864586:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439552 00000100:00100000:3.0:1782487587.864591:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439296 00010000:00010000:0.0:1782487587.864598:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 85 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864630:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439680 00010000:00010000:3.0:1782487587.864634:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864634:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439680 00010000:00010000:0.0:1782487587.864646:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 86 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864664:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6446 00000100:00100000:0.0:1782487587.864671:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6447 00000100:00100000:3.0:1782487587.864676:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+57:2362:x1869066294437888:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487587.864685:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+74:2363:x1869066294438272:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.864687:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.864696:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 57 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864699:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.864708:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 74 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864710:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 57 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864734:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 74 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864742:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6629a6e/0x66475b4e8b85c255 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba0 expref: 57 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864755:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca825abe/0x66475b4e8b85974b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1844:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a476f3d expref: 74 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864761:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.864773:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.864777:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1844:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.864783:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864794:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+56:2362:x1869066294437888:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (895us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.864794:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.864808:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6446 00010000:00010000:0.0:1782487587.864824:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.864848:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2363:x1869066294438272:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (876us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.864853:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864856:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6447 00010000:00010000:2.0:1782487587.864867:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864877:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6448 00010000:00010000:2.0:1782487587.864878:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.864889:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+55:2360:x1869066294437760:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.864890:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6449 00010000:00010000:2.0:1782487587.864892:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864901:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.864904:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2360:x1869066294438144:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.864909:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 55 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.864912:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.864914:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.864923:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 54 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864925:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 55 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864949:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 54 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864953:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374e1c42/0x66475b4e8b85c26a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bb5 expref: 55 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864976:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b40c47/0x66475b4e8b85c74f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb8 expref: 54 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.864977:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.864984:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.864991:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.864996:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.864997:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865001:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.865011:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865019:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865025:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.865032:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865041:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865047:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.865049:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865052:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+54:2360:x1869066294437760:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 167us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.865065:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6448 00010000:00010000:1.0:1782487587.865067:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865084:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6450 00010000:00010000:1.0:1782487587.865085:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.865093:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2360:x1869066294438528:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.865100:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.865103:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 53 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865110:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 53 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865118:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2360:x1869066294438144:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 215us (1072us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.865125:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e952796a/0x66475b4e8b85c844 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d36 expref: 53 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865131:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6449 00000100:00100000:2.0:1782487587.865136:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+149:3315:x1869066299293952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8682us (8748us total) trans 8589940822 rc 0/0 00000100:00100000:2.0:1782487587.865152:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554 00010000:00010000:0.0:1782487587.865152:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.865157:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.865160:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865165:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865177:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1782487587.865179:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6451 00010000:00010000:0.0:1782487587.865180:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.865184:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865208:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2360:x1869066294438016:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.865209:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.865215:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865219:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+51:2360:x1869066294438528:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.865234:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6450 00010000:00010000:2.0:1782487587.865235:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865242:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.865250:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 53 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865251:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865253:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6452 00000100:00100000:1.0:1782487587.865262:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+158:3316:x1869066299294208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10283us (10377us total) trans 8589940168 rc 0/0 00000100:00100000:0.0:1782487587.865265:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2360:x1869066294438400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.865276:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85eb9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1844:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865280:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 53 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.865280:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16551 00010000:00010000:0.0:1782487587.865280:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.865289:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 53 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865303:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.865311:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.865311:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865314:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9a199d7/0x66475b4e8b85c278 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bca expref: 53 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865316:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.865316:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 53 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865321:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.865332:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.865338:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865339:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865340:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.865341:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f378e80/0x66475b4e8b85c263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1842:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bae expref: 52 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865349:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1842:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.865359:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865362:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865368:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865383:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865392:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865412:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85eb8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865415:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865416:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487587.865426:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.865429:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865433:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.865438:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.865442:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+51:2360:x1869066294438400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (1303us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.865447:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.865448:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.865451:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6452 00010000:00010000:1.0:1782487587.865457:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865466:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.865466:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6453 00010000:00010000:1.0:1782487587.865472:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865478:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+86:2362:x1869066294438656:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.865479:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+50:2360:x1869066294438016:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 286us (1359us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.865486:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865490:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.865492:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6451 00010000:00010000:0.0:1782487587.865498:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865499:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.865515:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ebad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865517:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865541:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085debaf6/0x66475b4e8b859a2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1847:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47702b expref: 86 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865549:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6454 00010000:00010000:1.0:1782487587.865549:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.865551:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.865553:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.865555:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1847:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.865558:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.865560:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865561:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+49:2362:x1869066294438912:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.865573:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865576:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1782487587.865583:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3d500/2, rc 0, transno 8589940168 00010000:00010000:3.0:1782487587.865586:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.865595:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299294208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.865596:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865598:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.865601:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+158:3315:x1869066299295104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8530us (8655us total) trans 8589940169 rc 0/0 00010000:00010000:1.0:1782487587.865636:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.865638:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556 00010000:00010000:3.0:1782487587.865643:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073e69fbf/0x66475b4e8b85c25c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ba7 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865645:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+85:2362:x1869066294438656:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 171us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.865657:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6453 00010000:00010000:3.0:1782487587.865666:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.865672:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865679:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6455 00010000:00010000:1.0:1782487587.865685:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865687:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.865695:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+48:2360:x1869066294438784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.865709:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865710:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+48:2362:x1869066294438912:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 152us (1489us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487587.865711:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.865712:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865721:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 48 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865724:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6454 00010000:00010000:1.0:1782487587.865729:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865738:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865756:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6456 00010000:00010000:1.0:1782487587.865757:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865757:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 47 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865766:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.865770:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+84:2361:x1869066294439040:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.865782:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.865788:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.865790:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d32aa20/0x66475b4e8b85c27f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x183e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bc3 expref: 47 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865791:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 84 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865815:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 84 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865817:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.865825:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x183e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.865831:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865836:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e8d14b/0x66475b4e8b859f55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477127 expref: 84 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865848:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865853:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.865861:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.865870:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865879:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.865892:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.865898:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.865900:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.865915:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.865925:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865930:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+83:2361:x1869066294439040:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 160us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.865930:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+46:2360:x1869066294438784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 235us (1690us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.865939:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.865949:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6456 00000100:00100000:1.0:1782487587.865955:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+149:3316:x1869066299295360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9432us (9503us total) trans 8589940823 rc 0/0 00010000:00010000:2.0:1782487587.865960:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487587.865961:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6455 00000100:00100000:1.0:1782487587.865967:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555 00000100:00100000:0.0:1782487587.865990:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6457 00010000:00010000:1.0:1782487587.865992:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.865998:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866005:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2361:x1869066294439168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.866019:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.866019:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.866020:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6458 00010000:00010000:1.0:1782487587.866024:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866029:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 50 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.866035:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56f843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2362:x1869066294439424:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.866037:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866047:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.866052:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 50 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866053:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 50 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866055:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866075:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85eb91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1842:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866084:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 50 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866087:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b762232/0x66475b4e8b85c8ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1848:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d60 expref: 50 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866089:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+159:3315:x1869066299293824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8802us (9094us total) trans 8589940171 rc 0/0 00010000:00010000:1.0:1782487587.866090:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.866096:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866107:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557 00010000:00010000:3.0:1782487587.866112:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8413acc/0x66475b4e8b85c90f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d67 expref: 50 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866116:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.866119:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.866120:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866125:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.866127:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1848:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.866130:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.866134:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866137:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866138:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299298432:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.866139:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866157:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866163:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866165:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866168:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85eba6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782487587.866211:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.866216:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.866220:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866222:0:213226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299298432 00010000:00010000:0.0:1782487587.866222:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.866228:0:213226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299298432 00010000:00010000:1.0:1782487587.866232:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.866236:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56f843450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+48:2362:x1869066294439424:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (1856us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.866237:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.866243:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6458 00010000:00010000:1.0:1782487587.866246:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866254:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+47:2361:x1869066294439168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 252us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.866259:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16567 00010000:00010000:1.0:1782487587.866260:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866271:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ebb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x183e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866272:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6457 00000100:00100000:2.0:1782487587.866273:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+159:3314:x1869066299298432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487587.866292:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6459 00002000:00080000:2.0:1782487587.866296:0:213226:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6218 count 1 00010000:00010000:1.0:1782487587.866297:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.866301:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.866303:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+82:2361:x1869066294439552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.866304:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.866312:0:213226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866314:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.866314:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866322:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866325:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6460 00000100:00100000:0.0:1782487587.866341:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+46:2361:x1869066294439296:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.866342:0:213226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 46 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866345:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866356:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487587.866358:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866368:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 46 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866369:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866385:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782487587.866387:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e3cff8f/0x66475b4e8b859dbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4770b7 expref: 82 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866395:0:213226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.866396:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866402:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 46 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866404:0:213226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866408:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.866417:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.866421:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487587.866428:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866437:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866439:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd955730/0x66475b4e8b85c741 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1845:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cb1 expref: 46 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866448:0:213226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 46 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866467:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487587.866470:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.866472:0:213226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 45 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866476:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1845:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.866487:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.866493:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2361:x1869066294439552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 190us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.866493:0:213226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299298560:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.866507:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.866512:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6459 00010000:00010000:0.0:1782487587.866545:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.866546:0:213226:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe846c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.866562:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.866562:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+149:3317:x1869066299296512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8798us (8868us total) trans 8589940824 rc 0/0 00000100:00100000:3.0:1782487587.866563:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6461 00000100:00100000:1.0:1782487587.866579:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558 00000100:00100000:3.0:1782487587.866580:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2360:x1869066294439680:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.866584:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866584:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+45:2361:x1869066294439296:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 242us (2109us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.866600:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866602:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.866603:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.866629:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6460 00010000:00010000:3.0:1782487587.866633:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 80 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866636:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866639:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866660:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866671:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866672:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 80 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866682:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.866684:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.866698:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866699:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f087c25/0x66475b4e8b859a23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1846:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47701d expref: 80 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.866713:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1782487587.866724:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866731:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.866733:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866738:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1846:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.866747:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.866752:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1782487587.866756:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.866778:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.866802:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2360:x1869066294439680:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 228us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.866809:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6461 00000100:00100000:2.0:1782487587.866848:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+160:3315:x1869066299294976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8497us (8751us total) trans 8589940172 rc 0/0 00000100:00100000:2.0:1782487587.866856:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16560 00000004:00080000:2.0:1782487587.866898:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb96300/2, rc 0, transno 8589940824 00000100:00100000:2.0:1782487587.866909:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299296512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.866923:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb4add2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+161:3316:x1869066299296768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8693us (8859us total) trans 8589940173 rc 0/0 00000100:00100000:1.0:1782487587.866931:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16559 00000100:00100000:0.0:1782487587.866944:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+160:3317:x1869066299295232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10589us (10672us total) trans 8589940174 rc 0/0 00000100:00100000:0.0:1782487587.866953:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553 00010000:00010000:1.0:1782487587.866960:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.866963:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb95180/2, rc 0, transno 8589940174 00010000:00010000:1.0:1782487587.866973:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.866975:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299295232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.866989:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867000:0:200304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867001:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867022:0:200304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867027:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1782487587.867035:0:200304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867044:0:200304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867054:0:200304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1782487587.867277:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+150:3315:x1869066299296384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8846us (9127us total) trans 8589940825 rc 0/0 00000100:00100000:1.0:1782487587.867288:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16561 00000100:00100000:2.0:1782487587.867289:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+150:3315:x1869066299296256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8754us (9023us total) trans 8589940826 rc 0/0 00000100:00100000:2.0:1782487587.867300:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16562 00010000:00010000:1.0:1782487587.867313:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1782487587.867320:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867328:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.867333:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867341:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299298688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.867343:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867359:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867367:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ebbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867376:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.867386:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782487587.867391:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867399:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.867403:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.867412:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb94700/2, rc 0, transno 8589940826 00010000:00010000:1.0:1782487587.867412:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867426:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299296256:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.867428:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867438:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ebc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1845:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.867450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.867454:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299298176:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.867456:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782487587.867463:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867470:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.867472:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867475:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867475:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439936 00000100:00100000:0.0:1782487587.867482:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439936 00000100:00100000:3.0:1782487587.867483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.867496:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867507:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867507:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 79 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.867513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.867530:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045d7b893/0x66475b4e8b85ebc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1848:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867531:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.867542:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299298816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.867561:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.867564:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867564:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294439808 00000100:00100000:0.0:1782487587.867569:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294439808 00000100:00100000:2.0:1782487587.867575:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.867576:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.867581:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867589:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 80 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867591:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867602:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299298688 00000100:00100000:2.0:1782487587.867623:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299298688 00010000:00010000:1.0:1782487587.867636:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867645:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000362b80ea/0x66475b4e8b85eb98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1847:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867650:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440064 00000100:00100000:2.0:1782487587.867656:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299298816 00000100:00100000:0.0:1782487587.867656:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440064 00010000:00010000:1.0:1782487587.867660:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782487587.867662:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299298816 00010000:00010000:1.0:1782487587.867665:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867674:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.867677:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 81 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867679:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.867689:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16568 00000100:00100000:2.0:1782487587.867700:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+150:3315:x1869066299298688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.867703:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.867714:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6221 count 1 00010000:00010000:1.0:1782487587.867718:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867719:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6462 00010000:00010000:2.0:1782487587.867728:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867730:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ebd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867734:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+81:2360:x1869066294439936:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.867751:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.867756:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 81 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867761:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 81 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867767:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.867769:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.867774:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867777:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.867787:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867793:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.867793:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 81 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867800:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867816:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 81 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867820:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867824:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc9f272b/0x66475b4e8b85a0f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771ba expref: 81 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.867836:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 81 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867848:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867853:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.867861:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299298944:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.867862:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.867868:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ebd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1846:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 200304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.867874:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.867883:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb543521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+159:3317:x1869066299294592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12146us (12233us total) trans 8589940170 rc 0/0 00010000:00010000:1.0:1782487587.867886:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.867888:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867889:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.867893:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.867894:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1782487587.867915:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487587.867920:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16569 00010000:00010000:0.0:1782487587.867920:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.867921:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299298048:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.867933:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:3317:x1869066299298816:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.867934:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867936:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487587.867945:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6222 count 1 00000100:00100000:0.0:1782487587.867950:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+80:2360:x1869066294439936:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 217us (497us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.867956:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.867959:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867971:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6462 00000100:00100000:1.0:1782487587.867981:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299298304:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.867982:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.867986:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 79 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.867996:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.867996:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6463 00010000:00010000:2.0:1782487587.868007:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868008:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184e:0x0].0x0 since=3s v=(0 0) 00000100:00100000:0.0:1782487587.868012:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+79:2361:x1869066294439808:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.868017:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.868027:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.868028:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.868036:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.868039:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 79 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868053:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 79 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.868053:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5589e5f80/2, rc 0, transno 8589940173 00010000:00010000:0.0:1782487587.868056:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 79 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.868064:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5589e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299296768:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782487587.868071:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 79 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.868082:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6a300/2, rc 0, transno 8589940823 00000100:00100000:3.0:1782487587.868088:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299299200:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.868089:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000751e9167/0x66475b4e8b85a0ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47719e expref: 79 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.868092:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299295360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.868102:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782487587.868109:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.868112:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299299072:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.868115:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782487587.868119:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.868122:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.868137:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.868145:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.868166:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.868180:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+151:3317:x1869066299297920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7428us (7611us total) trans 8589940827 rc 0/0 00000100:00100000:0.0:1782487587.868204:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+78:2361:x1869066294439808:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 193us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.868209:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16565 00010000:00010000:1.0:1782487587.868214:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.868220:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6463 00000100:00100000:2.0:1782487587.868225:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299299072 00000100:00100000:2.0:1782487587.868230:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299299072 00010000:00010000:1.0:1782487587.868232:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868243:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.868243:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6464 00010000:00010000:1.0:1782487587.868255:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.868259:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16570 00000100:00100000:0.0:1782487587.868259:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+77:2361:x1869066294440064:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.868272:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb5492f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+159:3316:x1869066299299072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.868274:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.868278:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.868283:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 77 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.868286:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6219 count 1 00010000:00010000:0.0:1782487587.868300:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 77 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868302:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868328:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.868333:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ea7c99/0x66475b4e8b859f6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1849:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477143 expref: 77 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868342:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.868350:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.868355:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.868356:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.868366:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1849:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.868372:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868383:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.868394:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868400:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.868410:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+151:3316:x1869066299297792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7858us (7936us total) trans 8589940828 rc 0/0 00010000:00010000:0.0:1782487587.868420:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.868421:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299299456:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.868430:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16564 00000100:00100000:0.0:1782487587.868447:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+76:2361:x1869066294440064:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 192us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.868454:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.868455:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6464 00010000:00010000:1.0:1782487587.868456:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868468:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868477:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868484:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868493:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1782487587.868495:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549181880/2, rc 0, transno 8589940827 00000100:00100000:2.0:1782487587.868502:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299297920:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.868519:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549182300/2, rc 0, transno 8589940170 00000100:00100000:2.0:1782487587.868530:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299294592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.868582:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299299328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.868626:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.868656:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.868664:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299299584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.868694:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+151:3314:x1869066299297664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7868us (8040us total) trans 8589940829 rc 0/0 00000100:00100000:2.0:1782487587.868697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.868708:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16566 00000100:00100000:1.0:1782487587.868730:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299299328 00000100:00100000:1.0:1782487587.868734:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299299328 00000100:00100000:2.0:1782487587.868749:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299299584 00000100:00100000:2.0:1782487587.868754:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299299584 00000100:00100000:1.0:1782487587.868767:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16571 00000100:00100000:1.0:1782487587.868779:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+161:3314:x1869066299299328:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.868789:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16572 00002000:00080000:1.0:1782487587.868792:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6220 count 1 00000100:00100000:2.0:1782487587.868800:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+161:3314:x1869066299299584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.868808:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868810:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.868815:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6222 count 1 00010000:00010000:1.0:1782487587.868822:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 44 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868823:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868830:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868832:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.868838:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.868846:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868848:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868857:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 45 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.868859:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.868872:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 44 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868877:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782487587.868882:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1782487587.868886:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.868892:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 44 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868893:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.868920:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299299712:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.868932:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 45 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.868945:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 45 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.868957:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299299840:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.868972:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.868988:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84300 going to sleep for 11 seconds 00000004:00080000:1.0:1782487587.869003:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb559179c00/2, rc 0, transno 8589940828 00000100:00100000:1.0:1782487587.869012:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb559179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299297792:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.869022:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb96680/2, rc 0, transno 8589940825 00000100:00100000:2.0:1782487587.869029:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299296384:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.869043:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3d180/2, rc 0, transno 8589940171 00000100:00100000:2.0:1782487587.869054:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299293824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.869097:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299300096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.869122:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb5492f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299299968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.869131:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.869163:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487587.869178:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb95c00/2, rc 0, transno 8589940172 00000100:00100000:1.0:1782487587.869204:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299300480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.869231:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.869267:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299300096 00000100:00100000:1.0:1782487587.869272:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299300096 00000100:00100000:2.0:1782487587.869570:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299294976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.869590:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299299968 00000100:00100000:1.0:1782487587.869596:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299299968 00000100:00100000:2.0:1782487587.869662:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.869669:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299300480 00000100:00100000:2.0:1782487587.869673:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299300608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.869675:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299300480 00000100:00100000:1.0:1782487587.869710:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16573 00000100:00100000:2.0:1782487587.869711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.869723:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+153:3317:x1869066299300096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.869738:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6229 count 1 00000100:00100000:2.0:1782487587.869748:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299300608 00010000:00010000:1.0:1782487587.869750:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.869753:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299300608 00010000:00010000:1.0:1782487587.869766:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 72 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.869774:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1855:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.869778:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.869782:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.869783:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16574 00000100:00100000:2.0:1782487587.869795:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+153:3316:x1869066299299968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.869809:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6224 count 1 00010000:00010000:1.0:1782487587.869811:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 72 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.869824:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.869825:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 72 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.869856:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299300736:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.869859:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.869868:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1850:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.869872:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.869877:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.869900:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.869912:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.869913:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.869927:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299300864:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.869939:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16575 00000100:00100000:1.0:1782487587.869951:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+153:3316:x1869066299300480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.869956:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84000 going to sleep for 11 seconds 00002000:00080000:1.0:1782487587.869968:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6231 count 1 00000100:00100000:2.0:1782487587.869980:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16576 00010000:00010000:1.0:1782487587.869983:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.869993:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+163:3316:x1869066299300608:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.870000:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 75 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.870007:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6223 count 1 00010000:00010000:1.0:1782487587.870009:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1857:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.870014:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.870019:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870021:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870044:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870055:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 75 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870062:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.870068:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.870074:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870075:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 75 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.870093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.870100:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299300992:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.870109:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870113:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440192 00000100:00100000:0.0:1782487587.870118:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440192 00010000:00010000:2.0:1782487587.870123:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.870129:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.870138:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299301120:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.870138:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 45 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870146:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782487587.870154:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870163:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6465 00000100:00100000:2.0:1782487587.870167:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84600 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.870167:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.870174:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870176:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+45:2360:x1869066294440192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.870200:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.870209:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 45 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870211:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870218:0:213226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:213226:1869066299298560:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.870233:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 45 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870238:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870243:0:213226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870250:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e42f6773/0x66475b4e8b85cadd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477dd7 expref: 45 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870254:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ebec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.870279:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3df80/2, rc 0, transno 8589940822 00010000:00010000:0.0:1782487587.870287:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.870290:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1782487587.870291:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299293952:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.870293:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.870297:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870303:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.870306:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb96a00/2, rc 0, transno 8589940169 00010000:00010000:1.0:1782487587.870313:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.870317:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299295104:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.870321:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870322:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870347:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.870354:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6aa00/2, rc 0, transno 8589940829 00010000:00010000:0.0:1782487587.870361:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.870362:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299297664:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.870363:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870377:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85ebe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870379:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299300224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.870394:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+44:2360:x1869066294440192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 221us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.870405:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6465 00010000:00010000:1.0:1782487587.870409:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782487587.870415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.870417:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870426:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.870430:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870438:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870446:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299300224 00010000:00010000:1.0:1782487587.870450:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870451:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299300224 00010000:00010000:1.0:1782487587.870461:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ebf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870479:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.870483:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870484:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16577 00010000:00010000:1.0:1782487587.870494:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.870496:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+164:3314:x1869066299300224:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.870502:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.870510:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6221 count 1 00010000:00010000:1.0:1782487587.870521:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870524:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870546:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 45 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870546:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870568:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.870570:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1b626a3/0x66475b4e8b85ebde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1849:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870572:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.870580:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870597:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.870602:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.870603:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 45 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.870625:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.870636:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.870637:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 45 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870650:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299301376:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.870652:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.870694:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.870715:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299301632:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.870728:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.870729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.870744:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.870755:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440320 00000100:00100000:0.0:1782487587.870760:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440320 00010000:00010000:0.0:1782487587.870781:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 76 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870795:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299298944:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.870805:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6466 00000100:00100000:0.0:1782487587.870814:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+76:2361:x1869066294440320:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.870816:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870821:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.870828:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 76 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870839:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 76 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870844:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299301632 00000100:00100000:2.0:1782487587.870849:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299301632 00010000:00010000:0.0:1782487587.870853:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b0d76e/0x66475b4e8b85a203 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771dd expref: 76 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.870862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.870864:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.870868:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.870871:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.870877:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.870883:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16578 00000100:00100000:2.0:1782487587.870893:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+154:3316:x1869066299301632:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.870897:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.870905:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299299200:192.168.202.21@tcp:104: 00002000:00080000:2.0:1782487587.870906:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6225 count 1 00010000:00010000:2.0:1782487587.870922:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870923:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+75:2361:x1869066294440320:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 111us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487587.870924:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870940:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6466 00010000:00010000:2.0:1782487587.870950:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 72 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870958:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440448 00010000:00010000:2.0:1782487587.870962:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 74 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.870963:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440448 00010000:00010000:2.0:1782487587.870972:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1851:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.870976:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.870979:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 75 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.870981:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.871010:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6467 00000100:00100000:3.0:1782487587.871011:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:3314:x1869066299297408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11939us (12023us total) trans 8589940175 rc 0/0 00010000:00010000:2.0:1782487587.871019:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 75 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.871022:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16563 00000100:00100000:0.0:1782487587.871022:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+75:2361:x1869066294440448:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.871035:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.871040:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 75 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871041:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 75 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871068:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 75 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.871070:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299301760:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.871086:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d32d2aba/0x66475b4e8b85a20a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4771e4 expref: 75 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871094:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.871096:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.871100:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871105:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871118:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 72 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871119:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.871132:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 72 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.871143:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2361:x1869066294440448:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.871145:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299301888:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.871158:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6467 00000100:00100000:2.0:1782487587.871174:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.871205:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871209:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871220:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871222:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871239:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871240:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871260:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871272:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.871284:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.871296:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.871298:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.871304:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871313:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.871317:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871325:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871345:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871352:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb9fdbfe/0x66475b4e8b85ec08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871368:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.871373:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871380:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.871384:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871392:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871404:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871411:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ec01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.871430:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.871433:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.871437:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.871444:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.871467:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299300736:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.871483:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+156:3317:x1869066299298816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3555us (3911us total) trans 8589940830 rc 0/0 00010000:00010000:1.0:1782487587.871485:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.871492:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16569 00000100:00100000:2.0:1782487587.871499:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+156:3315:x1869066299298688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3798us (4122us total) trans 8589940831 rc 0/0 00000100:00100000:2.0:1782487587.871508:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16568 00000100:00100000:2.0:1782487587.871544:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299299840:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.871560:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.871588:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3c380/2, rc 0, transno 8589940830 00000100:00100000:2.0:1782487587.871604:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299298816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.871663:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.871672:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299302016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.871697:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.871721:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299302016 00000100:00100000:1.0:1782487587.871725:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299302016 00000100:00100000:2.0:1782487587.871757:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16579 00000100:00100000:2.0:1782487587.871768:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+155:3316:x1869066299302016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.871780:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6227 count 1 00010000:00010000:2.0:1782487587.871792:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871803:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871817:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1853:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.871820:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.871825:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871845:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871857:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.871868:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299302144:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.871913:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84300 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.871939:0:213226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871949:0:213226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871958:0:213226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871967:0:213226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.871991:0:213226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.871998:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.872005:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872015:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.872020:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872028:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872045:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872053:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85ebfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872079:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.872083:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.872087:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.872150:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+164:3314:x1869066299298432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5881us (5981us total) trans 8589940176 rc 0/0 00000100:00100000:2.0:1782487587.872158:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16567 00000100:00100000:2.0:1782487587.872179:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb453dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299300352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.872302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.872327:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299300352 00000100:00100000:1.0:1782487587.872332:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299300352 00000004:00080000:2.0:1782487587.872338:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3f800/2, rc 0, transno 8589940831 00000100:00100000:2.0:1782487587.872349:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299298688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.872362:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299301504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.872368:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16580 00000100:00100000:1.0:1782487587.872379:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+156:3315:x1869066299300352:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.872391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1782487587.872393:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6223 count 1 00010000:00010000:1.0:1782487587.872407:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872420:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 72 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872430:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.872438:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299301248:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.872439:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.872446:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.872451:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.872469:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299299456:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.872474:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.872484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.872486:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.872490:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.872504:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299302272:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.872506:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440576 00000100:00100000:0.0:1782487587.872511:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440576 00000100:00100000:3.0:1782487587.872515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.872528:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299300864:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.872530:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 46 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.872542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.872546:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872552:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 72 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.872556:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440704 00000100:00100000:0.0:1782487587.872561:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440704 00010000:00010000:1.0:1782487587.872569:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 73 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872575:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 73 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.872587:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299302400:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.872589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.872592:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440832 00000100:00100000:0.0:1782487587.872596:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440832 00010000:00010000:0.0:1782487587.872632:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 44 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.872642:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f4e00/2, rc 0, transno 8589940176 00000100:00100000:0.0:1782487587.872653:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6468 00000100:00100000:2.0:1782487587.872655:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299298432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.872664:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+46:2361:x1869066294440576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.872671:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.872677:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 46 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872690:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 46 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.872694:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.872700:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f6d80/2, rc 0, transno 8589940175 00000100:00100000:2.0:1782487587.872712:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299297408:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.872712:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5603113/0x66475b4e8b85ce72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ec5 expref: 46 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872726:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.872730:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.872733:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872739:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.872743:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299301504 00000100:00100000:1.0:1782487587.872748:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299301504 00010000:00010000:0.0:1782487587.872756:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.872757:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299302784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.872774:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299301248 00000100:00100000:0.0:1782487587.872779:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+45:2361:x1869066294440576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.872780:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299301248 00000100:00100000:0.0:1782487587.872787:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6468 00000100:00100000:0.0:1782487587.872807:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6469 00000100:00100000:1.0:1782487587.872809:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16581 00000100:00100000:2.0:1782487587.872811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.872820:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2360:x1869066294440704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.872821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.872821:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+157:3315:x1869066299301504:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.872833:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.872839:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 73 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.872840:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6232 count 1 00010000:00010000:2.0:1782487587.872854:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872855:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 73 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872856:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.872873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.872881:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872887:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 73 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872888:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000872b2c5f/0x66475b4e8b85aa4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47748b expref: 73 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.872899:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872915:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1858:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.872918:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872918:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.872921:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.872928:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.872932:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872939:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.872946:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.872961:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.872981:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 73 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.872983:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.872994:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 73 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873007:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57fdfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299302912:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.873009:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:2360:x1869066294440704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 190us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.873020:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6469 00000100:00100000:0.0:1782487587.873035:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294440960 00000100:00100000:0.0:1782487587.873039:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294440960 00000100:00100000:1.0:1782487587.873043:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.873056:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 45 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873062:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299302784 00000100:00100000:1.0:1782487587.873068:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299302784 00000100:00100000:0.0:1782487587.873076:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441088 00000100:00100000:0.0:1782487587.873080:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441088 00000100:00100000:2.0:1782487587.873088:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+166:3314:x1869066299299584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4289us (4391us total) trans 8589940177 rc 0/0 00010000:00010000:0.0:1782487587.873094:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.873098:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16572 00000100:00100000:1.0:1782487587.873107:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16582 00000100:00100000:0.0:1782487587.873117:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6470 00000100:00100000:1.0:1782487587.873119:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+165:3314:x1869066299301248:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487587.873125:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16583 00000100:00100000:0.0:1782487587.873130:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+45:2361:x1869066294440832:12345-192.168.202.21@tcp:103:ldlm_bl.0 00002000:00080000:1.0:1782487587.873137:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6227 count 1 00000100:00100000:2.0:1782487587.873138:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+165:3316:x1869066299302784:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.873142:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.873150:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 45 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873153:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.873155:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6226 count 1 00010000:00010000:2.0:1782487587.873169:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873171:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 45 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873177:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 45 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873210:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.873213:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487587.873218:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.873220:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873223:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.873224:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873228:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873244:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.873250:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.873259:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.873269:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873273:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.873289:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 45 pid: 213384 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873297:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+45:2361:x1869066294440832:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 172us (756us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.873299:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873306:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 45 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873311:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6470 00010000:00010000:2.0:1782487587.873325:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873327:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6471 00000100:00100000:1.0:1782487587.873331:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299303040:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.873338:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+44:2360:x1869066294440960:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.873348:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299303168:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.873350:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.873358:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873368:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.873370:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.873378:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe849c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.873387:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c3888dc/0x66475b4e8b85cc3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e16 expref: 44 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873397:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873400:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.873401:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299302528:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.873404:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873411:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.873427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.873429:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.873450:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873451:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+43:2360:x1869066294440960:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 116us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.873465:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6471 00010000:00010000:2.0:1782487587.873468:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873479:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6472 00010000:00010000:2.0:1782487587.873489:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873490:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:2361:x1869066294441088:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.873502:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.873503:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873511:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.873516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.873528:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.873530:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.873542:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008f9af04/0x66475b4e8b85a52f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772bd expref: 72 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873550:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873552:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873555:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873560:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873574:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.873587:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2361:x1869066294441088:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 100us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.873591:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6472 00010000:00010000:1.0:1782487587.873604:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffcb095a/0x66475b4e8b85cc49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e24 expref: 42 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873626:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441216 00000100:00100000:0.0:1782487587.873629:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441216 00010000:00010000:0.0:1782487587.873640:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 74 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873643:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:213228:1869066299299712:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.873658:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6473 00010000:00010000:1.0:1782487587.873665:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.873665:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2360:x1869066294441216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.873670:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.873677:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 74 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873679:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873699:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873701:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 74 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873718:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873724:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873730:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.873736:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873739:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873745:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873764:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.873766:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1782487587.873782:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2360:x1869066294441216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 117us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.873787:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6473 00000100:00100000:2.0:1782487587.873824:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb5492f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+166:3316:x1869066299299072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5553us (5680us total) trans 8589940178 rc 0/0 00000100:00100000:2.0:1782487587.873834:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16570 00000100:00100000:2.0:1782487587.873855:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299302528 00000100:00100000:2.0:1782487587.873860:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299302528 00000100:00100000:3.0:1782487587.873889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.873894:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16584 00000100:00100000:2.0:1782487587.873903:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:3314:x1869066299302528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782487587.873912:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441344 00002000:00080000:2.0:1782487587.873916:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6224 count 1 00000100:00100000:0.0:1782487587.873917:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441344 00010000:00010000:2.0:1782487587.873932:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873935:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873943:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+167:3314:x1869066299299328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5165us (5313us total) trans 8589940179 rc 0/0 00010000:00010000:2.0:1782487587.873955:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 45 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.873962:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16571 00000100:00100000:0.0:1782487587.873967:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6474 00010000:00010000:2.0:1782487587.873970:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.873974:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.873977:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+45:2361:x1869066294441344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.873980:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.873984:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.873991:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.873994:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.874002:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.874014:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 45 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874017:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.874020:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 45 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874025:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.874029:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.874038:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.874043:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 45 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.874046:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874049:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.874068:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.874072:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299303296:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.874076:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.874082:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.874087:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000837fd4e8/0x66475b4e8b85ec1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874104:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.874108:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874115:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.874120:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+45:2361:x1869066294441344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 143us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.874122:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.874124:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.874128:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6474 00010000:00010000:1.0:1782487587.874137:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874144:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874149:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874156:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874163:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a4786c2/0x66475b4e8b85ec0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874169:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874180:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874196:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.874203:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874209:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.874211:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.874217:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874226:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874245:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874254:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4793502/0x66475b4e8b85ec16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874275:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.874279:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874287:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.874291:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874300:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874314:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874322:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ec2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874346:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.874350:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.874354:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.874370:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.874379:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+158:3316:x1869066299299968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4584us (5217us total) trans 8589940832 rc 0/0 00010000:00010000:1.0:1782487587.874381:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.874392:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16574 00010000:00010000:1.0:1782487587.874398:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874407:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874416:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.874425:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782487587.874443:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f7800/2, rc 0, transno 8589940832 00000100:00100000:2.0:1782487587.874559:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299299968:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.874579:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f5880/2, rc 0, transno 8589940178 00000100:00100000:1.0:1782487587.874584:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+158:3317:x1869066299300096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4864us (5456us total) trans 8589940833 rc 0/0 00000100:00100000:2.0:1782487587.874591:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299299072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.874592:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16573 00010000:00010000:1.0:1782487587.874659:0:213210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b713df4/0x66475b4e8b85ad71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477572 expref: 73 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874665:0:213693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044c77f90/0x66475b4e8b85d00f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f5f expref: 44 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.874680:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299300992:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.874686:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299301120:192.168.202.21@tcp:104: 00000004:00080000:3.0:1782487587.874692:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3e300/2, rc 0, transno 8589940177 00010000:00010000:1.0:1782487587.874703:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.874705:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299299584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.874709:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874713:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874724:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874747:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874747:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874772:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874774:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.874788:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.874791:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.874807:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb5492f4380/2, rc 0, transno 8589940179 00000100:00100000:3.0:1782487587.874813:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb5492f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299299328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487587.874814:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.874815:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1782487587.874826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782487587.874835:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299302656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.874865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.874919:0:190928:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299302656 00000100:00100000:3.0:1782487587.874924:0:190928:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299302656 00000100:00100000:3.0:1782487587.874960:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16585 00000100:00100000:3.0:1782487587.874970:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:3314:x1869066299302656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782487587.874984:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6226 count 1 00010000:00010000:3.0:1782487587.874998:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.875010:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 70 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.875018:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1852:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782487587.875021:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.875025:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875047:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+167:3316:x1869066299300608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5057us (5337us total) trans 8589940180 rc 0/0 00010000:00010000:3.0:1782487587.875048:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 70 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.875061:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+159:3316:x1869066299300480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5113us (5830us total) trans 8589940834 rc 0/0 00000100:00100000:2.0:1782487587.875063:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16576 00010000:00010000:3.0:1782487587.875069:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 70 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.875074:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16575 00000100:00100000:3.0:1782487587.875081:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299303424:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.875091:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.875098:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875106:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.875110:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875120:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.875128:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.875135:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875144:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ec24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875166:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.875170:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875178:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.875183:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875211:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.875217:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875226:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.875230:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875239:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875253:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875262:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ec32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875282:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.875285:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.875288:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.875296:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.875338:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.875358:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875373:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875381:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005993f425/0x66475b4e8b85ec39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.875400:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.875402:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.875406:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.875434:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb97800/2, rc 0, transno 8589940180 00000100:00100000:2.0:1782487587.875442:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299300608:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487587.875455:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfed80/2, rc 0, transno 8589940834 00000100:00100000:2.0:1782487587.875466:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299300480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.875472:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.875481:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299303552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.875511:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.875583:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299303552 00000100:00100000:2.0:1782487587.875587:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299303552 00000100:00100000:1.0:1782487587.875645:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16586 00000100:00100000:1.0:1782487587.875656:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+159:3316:x1869066299303552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.875670:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6228 count 1 00010000:00010000:1.0:1782487587.875684:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875694:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:213221:1869066299301376:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.875698:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 70 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875707:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1854:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.875710:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.875712:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875715:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.875753:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 70 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875768:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299301760:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.875772:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 70 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875786:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299301888:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.875787:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299303808:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.875812:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.875843:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00000004:00080000:2.0:1782487587.875852:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb4a1df5180/2, rc 0, transno 8589940833 00000100:00100000:2.0:1782487587.875863:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4a1df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299300096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.875876:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299302912:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.875891:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875907:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299302144:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.875923:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.875928:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299303040:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.875950:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.875961:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299303936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.875988:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299302272:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.875993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.876013:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299302400:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.876025:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487587.876035:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299303680:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.876039:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.876066:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299303936 00000100:00100000:2.0:1782487587.876068:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.876071:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299303936 00000100:00100000:2.0:1782487587.876100:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299303680 00000100:00100000:2.0:1782487587.876106:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299303680 00000100:00100000:1.0:1782487587.876106:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16587 00000100:00100000:1.0:1782487587.876119:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+161:3315:x1869066299303936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.876133:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6233 count 1 00000100:00100000:2.0:1782487587.876141:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16588 00010000:00010000:1.0:1782487587.876147:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.876153:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+161:3315:x1869066299303680:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.876168:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 70 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.876170:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6230 count 1 00010000:00010000:1.0:1782487587.876180:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.876185:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.876198:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.876199:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.876226:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 70 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.876235:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1856:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.876238:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 70 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.876240:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.876249:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.876257:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 70 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.876271:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299304064:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.876277:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 70 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.876290:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 70 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.876304:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299304192:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.876306:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.876335:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84300 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.876362:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299303296:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.876377:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.876404:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299303168:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.876417:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.876933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.876956:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441472 00000100:00100000:3.0:1782487587.876957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.876963:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441472 00000100:00100000:3.0:1782487587.876978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.876986:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 44 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.876997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.877008:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441600 00000100:00100000:0.0:1782487587.877012:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441600 00010000:00010000:0.0:1782487587.877024:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 71 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.877026:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.877045:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441856 00000100:00100000:0.0:1782487587.877049:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441856 00000100:00100000:3.0:1782487587.877050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.877062:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 72 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.877071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.877080:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442112 00000100:00100000:0.0:1782487587.877083:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442112 00000100:00100000:3.0:1782487587.877090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.877095:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 73 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877109:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442368 00000100:00100000:3.0:1782487587.877110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.877115:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442368 00010000:00010000:0.0:1782487587.877131:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 45 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877146:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442624 00000100:00100000:0.0:1782487587.877149:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442624 00010000:00010000:0.0:1782487587.877161:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 46 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877176:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441728 00000100:00100000:0.0:1782487587.877179:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441728 00010000:00010000:0.0:1782487587.877202:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 73 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877217:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294441984 00000100:00100000:0.0:1782487587.877220:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294441984 00010000:00010000:0.0:1782487587.877229:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 74 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877243:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442240 00000100:00100000:0.0:1782487587.877246:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442240 00010000:00010000:0.0:1782487587.877259:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 42 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877275:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6475 00000100:00100000:3.0:1782487587.877287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.877287:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+46:2360:x1869066294441472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.877299:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.877306:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 46 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877319:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 46 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877334:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a91bf641/0x66475b4e8b85ce6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x184d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ebe expref: 46 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877347:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.877351:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x184d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.877356:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877364:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877389:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.877412:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877422:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+45:2360:x1869066294441472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.877426:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877437:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6475 00010000:00010000:2.0:1782487587.877440:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.877450:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877457:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442496 00000100:00100000:0.0:1782487587.877462:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442496 00010000:00010000:2.0:1782487587.877470:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.877477:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.877477:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 75 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.877485:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.877495:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.877500:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877501:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6476 00010000:00010000:1.0:1782487587.877513:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877514:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+73:2361:x1869066294441600:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.877529:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.877534:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877536:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 73 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.877554:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1626684/0x66475b4e8b85ec40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x184d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877559:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 73 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877580:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6158c27/0x66475b4e8b85aa76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477499 expref: 73 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.877581:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.877585:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.877588:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.877603:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.877636:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299303808:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.877652:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.877653:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:2361:x1869066294441600:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.877668:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+167:3314:x1869066299300224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7173us (7254us total) trans 8589940181 rc 0/0 00000100:00100000:0.0:1782487587.877674:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6476 00000100:00100000:2.0:1782487587.877680:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16577 00000100:00100000:0.0:1782487587.877700:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6477 00000100:00100000:0.0:1782487587.877710:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2361:x1869066294441856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.877719:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.877725:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.877728:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb543523100/2, rc 0, transno 8589940181 00000100:00100000:2.0:1782487587.877742:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299300224:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.877743:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877764:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070bc5441/0x66475b4e8b85a536 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4772b6 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877779:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.877807:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:2361:x1869066294441856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 99us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.877815:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6477 00000100:00100000:0.0:1782487587.877835:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6478 00000100:00100000:0.0:1782487587.877845:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+75:2361:x1869066294442112:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.877854:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.877861:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 75 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.877867:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299303424:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.877877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.877885:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 75 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.877889:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877909:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf9a745e/0x66475b4e8b85ad78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477579 expref: 75 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.877910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.877927:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.877931:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.877936:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877945:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.877969:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.877982:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299304064:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.877984:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299304192:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.878003:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2361:x1869066294442112:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (1005us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.878004:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878006:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878021:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6478 00000100:00100000:0.0:1782487587.878044:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442752 00010000:00010000:1.0:1782487587.878046:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878050:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442752 00010000:00010000:1.0:1782487587.878059:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878066:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 70 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878070:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878085:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878089:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294442880 00000100:00100000:0.0:1782487587.878094:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294442880 00010000:00010000:1.0:1782487587.878102:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.878110:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 71 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878127:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6479 00000100:00100000:0.0:1782487587.878136:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56f840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+44:2361:x1869066294442368:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.878144:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.878150:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878159:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878174:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003586aecc/0x66475b4e8b85d476 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780b6 expref: 44 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878196:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.878200:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.878204:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878213:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878236:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.878253:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+162:3315:x1869066299301504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5433us (5862us total) trans 8589940835 rc 0/0 00010000:00010000:2.0:1782487587.878256:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878263:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56f840c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+43:2361:x1869066294442368:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 125us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.878269:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16581 00010000:00010000:2.0:1782487587.878276:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878283:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6479 00010000:00010000:2.0:1782487587.878290:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878295:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.878301:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878304:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878321:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6480 00010000:00010000:1.0:1782487587.878323:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.878325:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.878329:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878333:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+42:2361:x1869066294442624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.878347:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878347:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.878356:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 42 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878365:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878370:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 42 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878381:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ec5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878393:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700af445/0x66475b4e8b85d47d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1850:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478093 expref: 42 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878402:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.878406:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.878408:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878413:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1850:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.878422:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878423:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.878429:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878437:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.878441:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.878452:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+167:3316:x1869066299302784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5316us (5646us total) trans 8589940182 rc 0/0 00000100:00100000:2.0:1782487587.878462:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16583 00010000:00010000:1.0:1782487587.878462:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878465:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.878474:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1ef004a/0x66475b4e8b85ec6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.878476:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.878494:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.878498:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.878498:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+41:2361:x1869066294442624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 166us (1446us total) trans 0 rc 0/0 00000004:00080000:2.0:1782487587.878500:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3e680/2, rc 0, transno 8589940182 00010000:00010000:1.0:1782487587.878503:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.878513:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299302784:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487587.878514:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.878514:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6480 00000100:00100000:0.0:1782487587.878538:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443008 00000100:00100000:0.0:1782487587.878542:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443008 00010000:00010000:2.0:1782487587.878546:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878556:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878558:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 72 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878587:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878596:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878596:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6481 00000100:00100000:0.0:1782487587.878629:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+72:2360:x1869066294441728:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.878638:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.878644:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878654:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.878659:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878676:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e1ba834/0x66475b4e8b85aa68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a7 expref: 72 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878689:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.878693:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.878698:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878706:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.878731:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.878901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.878901:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2360:x1869066294441728:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 292us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.878912:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6481 00000100:00100000:2.0:1782487587.878920:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:3314:x1869066299302528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5016us (5492us total) trans 8589940183 rc 0/0 00000100:00100000:2.0:1782487587.878929:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16584 00000100:00100000:0.0:1782487587.878931:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443136 00000100:00100000:0.0:1782487587.878936:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443136 00010000:00010000:2.0:1782487587.878951:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.878952:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 71 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878958:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.878971:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.878976:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878983:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6482 00010000:00010000:2.0:1782487587.878988:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.878995:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+73:2360:x1869066294441984:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.879006:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879006:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.879015:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879018:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85ec71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1850:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879041:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879052:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.879056:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.879060:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.879060:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085124850/0x66475b4e8b85a800 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x184f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4773b2 expref: 73 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879074:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879078:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x184f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.879079:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879086:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879091:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879105:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879107:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879129:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879147:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.879150:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.879153:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879161:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879167:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879173:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.879180:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+72:2360:x1869066294441984:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.879199:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6482 00010000:00010000:1.0:1782487587.879201:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.879217:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6483 00000100:00100000:0.0:1782487587.879228:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+42:2360:x1869066294442240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.879238:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.879243:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 42 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879256:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 42 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879272:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000699670f/0x66475b4e8b85d54f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1853:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780fc expref: 42 pid: 213384 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879284:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879287:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1853:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879292:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879301:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879327:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+162:3316:x1869066299302016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7562us (7629us total) trans 8589940836 rc 0/0 00010000:00010000:0.0:1782487587.879329:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.879337:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16579 00000100:00100000:0.0:1782487587.879363:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+41:2360:x1869066294442240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (2253us total) trans 0 rc 0/0 00000004:00080000:2.0:1782487587.879371:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd4000/2, rc 0, transno 8589940836 00000100:00100000:0.0:1782487587.879372:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6483 00000100:00100000:2.0:1782487587.879383:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299302016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.879395:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+162:3315:x1869066299300352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7017us (7092us total) trans 8589940837 rc 0/0 00000100:00100000:0.0:1782487587.879399:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6484 00000100:00100000:1.0:1782487587.879409:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16580 00000100:00100000:0.0:1782487587.879414:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+71:2360:x1869066294442496:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.879425:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.879431:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 71 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879434:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299304320:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.879434:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.879441:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879455:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.879457:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 71 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879460:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879471:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.879482:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879487:0:192528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424b5d89/0x66475b4e8b85ae3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4775aa expref: 71 pid: 213227 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879500:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879502:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879510:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1851:0x0].0x0 since=0s v=(0 0) 00000004:00080000:2.0:1782487587.879512:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57fdfc700/2, rc 0, transno 8589940835 00010000:00010000:1.0:1782487587.879515:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000398a8eb2/0x66475b4e8b85ec4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879519:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879523:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57fdfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299301504:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.879539:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879545:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.879552:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879554:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.879564:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299304448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.879568:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.879574:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879575:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.879584:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879593:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487587.879604:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+70:2360:x1869066294442496:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 192us (2320us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.879624:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879633:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ec55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x184f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.879650:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879651:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.879651:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6484 00010000:00010000:1.0:1782487587.879656:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.879660:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.879666:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879670:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.879677:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879684:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.879685:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6485 00010000:00010000:2.0:1782487587.879692:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.879701:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+71:2360:x1869066294442752:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.879702:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.879712:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb453dd2d80/2, rc 0, transno 8589940837 00010000:00010000:2.0:1782487587.879716:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.879717:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879717:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782487587.879723:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb453dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299300352:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.879727:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 71 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.879730:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879753:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 71 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.879757:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb558a3f480/2, rc 0, transno 8589940183 00010000:00010000:1.0:1782487587.879757:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487587.879768:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299302528:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487587.879775:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf2f6cc/0x66475b4e8b85aa61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1852:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774a0 expref: 71 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879789:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879792:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1852:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.879797:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879805:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879836:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.879858:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+70:2360:x1869066294442752:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.879866:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6485 00010000:00010000:3.0:1782487587.879868:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.879879:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879885:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+162:3316:x1869066299301632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8991us (9139us total) trans 8589940838 rc 0/0 00000100:00100000:0.0:1782487587.879890:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6486 00010000:00010000:3.0:1782487587.879892:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879899:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16578 00000100:00100000:0.0:1782487587.879907:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb56f843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+69:2360:x1869066294442880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487587.879910:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879919:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299304320 00010000:00010000:0.0:1782487587.879921:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.879923:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299304320 00010000:00010000:3.0:1782487587.879929:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1782487587.879930:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.879945:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.879949:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299304448 00000100:00100000:2.0:1782487587.879953:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299304448 00010000:00010000:0.0:1782487587.879966:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037899f8c/0x66475b4e8b85aa53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477492 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.879977:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+167:3314:x1869066299301248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6860us (7387us total) trans 8589940184 rc 0/0 00010000:00010000:0.0:1782487587.879980:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1854:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.879983:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16589 00010000:00010000:0.0:1782487587.879989:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1854:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.879993:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16582 00000100:00100000:2.0:1782487587.879997:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+163:3316:x1869066299304320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.880000:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880011:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.880013:0:213225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6236 count 1 00000100:00100000:1.0:1782487587.880016:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16590 00000100:00100000:1.0:1782487587.880029:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+164:3316:x1869066299304448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.880030:0:213225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880048:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.880049:0:213225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 69 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.880049:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6234 count 1 00010000:00010000:2.0:1782487587.880060:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.880065:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.880066:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:3314:x1869066299302656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5096us (5199us total) trans 8589940839 rc 0/0 00010000:00010000:2.0:1782487587.880067:0:213225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.880076:0:213225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880078:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb56f843c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+68:2360:x1869066294442880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 173us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.880083:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16585 00010000:00010000:1.0:1782487587.880088:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880100:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6486 00010000:00010000:1.0:1782487587.880107:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185a:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.880113:0:213225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 69 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880113:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.880122:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880131:0:213225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 69 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880136:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6487 00000100:00100000:0.0:1782487587.880150:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2360:x1869066294443008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.880151:0:213225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299304576:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.880151:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 69 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880167:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.880171:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 69 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880176:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 67 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.880200:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299304704:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.880204:0:213225:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe846c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.880207:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 67 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880216:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782487587.880223:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880225:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded6260b/0x66475b4e8b85aa7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4774ae expref: 67 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.880232:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447180 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.880245:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.880250:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880251:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.880260:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.880271:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880275:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880288:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880297:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880313:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ec47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880318:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880327:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.880329:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880331:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.880338:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880342:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880349:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2360:x1869066294443008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 201us (1872us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.880351:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.880357:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880361:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880370:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6487 00010000:00010000:2.0:1782487587.880380:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880387:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.880393:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880395:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6488 00010000:00010000:2.0:1782487587.880406:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ec63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1853:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880411:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2360:x1869066294443136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.880425:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.880433:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 65 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880434:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.880440:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880452:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.880453:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 65 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880456:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880478:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.880487:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+164:3316:x1869066299303552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4831us (4974us total) trans 8589940840 rc 0/0 00010000:00010000:0.0:1782487587.880488:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f108bd/0x66475b4e8b85b16f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47766e expref: 65 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880491:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.880499:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16586 00010000:00010000:2.0:1782487587.880513:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b25b73/0x66475b4e8b85ec78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1852:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880516:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.880518:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.880522:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880528:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.880536:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.880539:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880540:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.880543:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.880545:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.880549:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880555:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880557:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880581:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880582:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.880591:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ec7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.880595:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.880628:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.880630:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c7480/2, rc 0, transno 8589940840 00000100:00100000:3.0:1782487587.880631:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782487587.880631:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.880635:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.880645:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299303552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.880646:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299304832:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.880647:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.880652:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+64:2360:x1869066294443136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 242us (1751us total) trans 0 rc 0/0 00000004:00080000:2.0:1782487587.880660:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd6d80/2, rc 0, transno 8589940838 00010000:00010000:1.0:1782487587.880669:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.880671:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299301632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.880673:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6488 00010000:00010000:1.0:1782487587.880686:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880699:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.880713:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.880732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.880747:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.880753:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880761:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.880765:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880775:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880789:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880797:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ec86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.880817:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.880821:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.880825:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299304960:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.880826:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.880843:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299305088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.880857:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.880872:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+164:3315:x1869066299303936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4756us (4882us total) trans 8589940841 rc 0/0 00000100:00100000:1.0:1782487587.880880:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16587 00000100:00100000:2.0:1782487587.880887:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782487587.880892:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee9c00/2, rc 0, transno 8589940841 00000100:00100000:3.0:1782487587.880904:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299303936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.880909:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299304832 00000100:00100000:1.0:1782487587.880912:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299304832 00000100:00100000:1.0:1782487587.880937:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299304960 00000100:00100000:1.0:1782487587.880941:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299304960 00000100:00100000:2.0:1782487587.880957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782487587.880965:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299305088 00000100:00100000:2.0:1782487587.880967:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299305216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.880969:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299305088 00000100:00100000:1.0:1782487587.880996:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16591 00000100:00100000:2.0:1782487587.881001:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.881008:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+166:3315:x1869066299304832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.881021:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6235 count 1 00010000:00010000:1.0:1782487587.881033:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881036:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881046:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 69 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881050:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881055:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185b:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.881062:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.881066:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881068:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881093:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881104:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 69 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881108:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.881113:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 69 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.881123:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299305344:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.881164:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.881181:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299305216 00000100:00100000:1.0:1782487587.881184:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299305216 00000100:00100000:1.0:1782487587.881230:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16592 00000100:00100000:1.0:1782487587.881240:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+168:3315:x1869066299304960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.881254:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6237 count 1 00010000:00010000:1.0:1782487587.881269:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881281:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 69 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881287:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782487587.881291:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.881295:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.881303:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+168:3315:x1869066299303680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5151us (5235us total) trans 8589940842 rc 0/0 00000100:00100000:2.0:1782487587.881319:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16588 00010000:00010000:1.0:1782487587.881333:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 69 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.881341:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16593 00010000:00010000:1.0:1782487587.881352:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 69 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.881355:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+167:3316:x1869066299305088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.881373:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6238 count 1 00000100:00100000:1.0:1782487587.881373:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299305472:192.168.202.21@tcp:104: 00000004:00080000:3.0:1782487587.881377:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee9f80/2, rc 0, transno 8589940842 00010000:00010000:2.0:1782487587.881388:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.881389:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299303680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.881402:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.881408:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 69 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881417:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782487587.881421:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.881425:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16594 00010000:00010000:2.0:1782487587.881429:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.881439:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+167:3316:x1869066299305216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.881454:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 69 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.881456:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6239 count 1 00010000:00010000:2.0:1782487587.881469:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 69 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881473:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.881485:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299305600:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.881493:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881502:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.881505:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.881508:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84600 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.881510:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881535:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881553:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881557:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.881565:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.881569:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299305728:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.881580:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.881585:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782487587.881586:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.881597:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.881599:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299305856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.881599:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447600 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.881638:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881638:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.881650:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab8d0d4/0x66475b4e8b85ec8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487587.881665:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb55afd5c00/2, rc 0, transno 8589940839 00010000:00010000:2.0:1782487587.881674:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.881678:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.881680:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299302656:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.881682:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.881723:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782487587.881732:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb94000/2, rc 0, transno 8589940184 00000100:00100000:1.0:1782487587.881742:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299301248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487587.881754:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.881761:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299305984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.881796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.881826:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299305856 00000100:00100000:1.0:1782487587.881830:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299305856 00000100:00100000:1.0:1782487587.881866:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299305984 00000100:00100000:1.0:1782487587.881870:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299305984 00000100:00100000:1.0:1782487587.881895:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16595 00000100:00100000:1.0:1782487587.881904:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+169:3315:x1869066299305856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.881916:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6241 count 1 00000100:00100000:3.0:1782487587.881923:0:190928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16596 00010000:00010000:1.0:1782487587.881928:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.881934:0:190928:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:3314:x1869066299305984:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.881940:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487587.881945:0:190928:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6240 count 1 00010000:00010000:1.0:1782487587.881948:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1861:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.881951:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1861:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.881955:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.881956:0:190928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.881968:0:190928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 63 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.881974:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.881974:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.881978:0:190928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.881982:0:190928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.881984:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.881995:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299306112:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.882036:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1782487587.882046:0:190928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 63 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.882056:0:190928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 63 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.882068:0:190928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299306240:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.882098:0:190928:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545be000 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.884577:0:213225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:213225:1869066299304576:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.884600:0:213225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.884625:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299304704:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.884645:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.884684:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299305344:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.884697:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.884735:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299305600:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.884739:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299305472:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.884756:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.884761:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.884773:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.884791:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:192482:1869066299306112:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.884797:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443392 00000100:00100000:3.0:1782487587.884802:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.884802:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.884803:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443392 00000100:00100000:3.0:1782487587.884828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.884828:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299305728:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.884828:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 70 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.884842:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.884849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.884857:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443648 00000100:00100000:0.0:1782487587.884862:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443648 00000100:00100000:3.0:1782487587.884874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.884879:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 71 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.884893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.884905:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443904 00000100:00100000:3.0:1782487587.884910:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.884911:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443904 00010000:00010000:0.0:1782487587.884930:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 72 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.884946:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444160 00000100:00100000:0.0:1782487587.884949:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444160 00000100:00100000:3.0:1782487587.884958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.884965:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 73 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.884983:0:190928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:190928:1869066299306240:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.884984:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443264 00000100:00100000:0.0:1782487587.884989:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443264 00010000:00010000:3.0:1782487587.884998:0:190928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885006:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 64 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885025:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443520 00000100:00100000:0.0:1782487587.885029:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443520 00010000:00010000:0.0:1782487587.885041:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 74 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885057:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294443776 00000100:00100000:0.0:1782487587.885060:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294443776 00010000:00010000:0.0:1782487587.885072:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 75 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885085:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444032 00000100:00100000:0.0:1782487587.885088:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444032 00010000:00010000:0.0:1782487587.885099:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885115:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6489 00000100:00100000:0.0:1782487587.885124:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+75:2361:x1869066294443392:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.885134:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.885140:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 75 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885153:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 75 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885176:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7ae589/0x66475b4e8b85b36e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477763 expref: 75 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885200:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.885204:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.885209:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885220:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885244:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.885267:0:213225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885278:0:213225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885279:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+74:2361:x1869066294443392:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 154us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.885294:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6489 00010000:00010000:2.0:1782487587.885305:0:213225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885315:0:213225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885318:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6490 00000100:00100000:0.0:1782487587.885331:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+73:2361:x1869066294443648:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.885338:0:213225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.885341:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.885348:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 73 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885353:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.885361:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885365:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 73 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885376:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.885382:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885403:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885410:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ee9d11/0x66475b4e8b85b504 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4777d3 expref: 73 pid: 213221 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885419:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885424:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.885430:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.885431:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ec94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885434:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885448:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885459:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.885462:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.885464:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.885468:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.885476:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.885483:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885488:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+72:2361:x1869066294443648:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (684us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.885495:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885498:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6490 00010000:00010000:1.0:1782487587.885505:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885515:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6491 00000100:00100000:0.0:1782487587.885520:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+71:2361:x1869066294443904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.885522:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.885526:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.885530:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 71 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885533:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.885540:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885541:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 71 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885563:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.885569:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885572:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007476b187/0x66475b4e8b85b6b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477843 expref: 71 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885593:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.885596:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.885597:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885600:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885670:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885673:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885684:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f89cd05c/0x66475b4e8b85eca2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885702:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.885704:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.885707:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.885710:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.885720:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885729:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885731:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+70:2361:x1869066294443904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 210us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.885744:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+170:3315:x1869066299304832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4736us (5010us total) trans 8589940843 rc 0/0 00000100:00100000:0.0:1782487587.885746:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6491 00010000:00010000:2.0:1782487587.885747:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.885762:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.885763:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16591 00000100:00100000:0.0:1782487587.885766:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6492 00000100:00100000:0.0:1782487587.885777:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+69:2361:x1869066294444160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.885783:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.885785:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.885790:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.885792:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.885796:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885804:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.885808:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.885815:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.885818:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eeb480/2, rc 0, transno 8589940843 00010000:00010000:1.0:1782487587.885827:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885827:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef047c1/0x66475b4e8b85b7ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47785f expref: 69 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.885831:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299304832:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.885850:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.885853:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.885855:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885857:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885876:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.885877:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbb2fa9/0x66475b4e8b85ecb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885895:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.885902:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.885906:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.885909:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.885921:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+170:3316:x1869066299305088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4570us (5037us total) trans 8589940844 rc 0/0 00000100:00100000:0.0:1782487587.885926:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+68:2361:x1869066294444160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 148us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.885935:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16593 00000100:00100000:0.0:1782487587.885936:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6492 00010000:00010000:1.0:1782487587.885957:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.885958:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6493 00000100:00100000:0.0:1782487587.885967:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2361:x1869066294443264:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.885969:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299306368:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.885973:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.885979:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.885986:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 65 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.886003:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.886003:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886007:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 65 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886025:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.886027:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eeb800/2, rc 0, transno 8589940844 00010000:00010000:0.0:1782487587.886034:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb49cd2/0x66475b4e8b85ba44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1860:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47792a expref: 65 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.886038:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299305088:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.886052:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886055:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1860:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.886056:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.886058:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886064:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886079:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.886093:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+64:2361:x1869066294443264:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 129us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.886098:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6493 00000100:00100000:0.0:1782487587.886129:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6494 00000100:00100000:0.0:1782487587.886137:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+67:2361:x1869066294443520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.886144:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.886147:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886155:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886168:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b3c724/0x66475b4e8b85b30c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477724 expref: 67 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886176:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886178:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886180:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886197:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886211:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.886228:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+66:2361:x1869066294443520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 93us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.886233:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6494 00000100:00100000:0.0:1782487587.886247:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6495 00000100:00100000:0.0:1782487587.886255:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+65:2361:x1869066294443776:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.886261:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.886265:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 65 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.886273:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+171:3316:x1869066299304320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6277us (6804us total) trans 8589940845 rc 0/0 00010000:00010000:0.0:1782487587.886277:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 65 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.886287:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16589 00000100:00100000:1.0:1782487587.886295:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+171:3316:x1869066299305216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4859us (5295us total) trans 8589940846 rc 0/0 00010000:00010000:0.0:1782487587.886301:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7c0b090/0x66475b4e8b85b6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x185d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477835 expref: 65 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.886305:0:213225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299306368 00000100:00100000:1.0:1782487587.886309:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16594 00000100:00100000:2.0:1782487587.886311:0:213225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299306368 00010000:00010000:0.0:1782487587.886322:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886326:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x185d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886331:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.886335:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16597 00010000:00010000:0.0:1782487587.886344:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.886347:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+170:3316:x1869066299306368:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.886361:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee8700/2, rc 0, transno 8589940846 00000100:00100000:2.0:1782487587.886367:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299305216:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.886368:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6242 count 1 00010000:00010000:0.0:1782487587.886371:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1782487587.886380:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee9880/2, rc 0, transno 8589940845 00000100:00100000:2.0:1782487587.886387:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299304320:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.886389:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.886399:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+64:2361:x1869066294443776:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (1486us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.886405:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 63 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.886411:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6495 00010000:00010000:1.0:1782487587.886420:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.886424:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.886426:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6496 00010000:00010000:1.0:1782487587.886430:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.886434:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+63:2361:x1869066294444032:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.886444:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.886449:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886458:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886461:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 63 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886488:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000920f8b01/0x66475b4e8b85b9c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1861:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477907 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886492:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 63 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886497:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1861:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886503:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1861:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.886511:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.886515:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299306496:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.886518:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886533:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.886551:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+62:2361:x1869066294444032:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 118us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.886555:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6496 00000100:00100000:1.0:1782487587.886557:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447540 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.886583:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886590:0:190928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886592:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886604:0:190928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886631:0:190928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886637:0:190928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.886649:0:190928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487587.886652:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886661:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886662:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.886670:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886680:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.886682:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.886685:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886695:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886716:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886725:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9cbf43/0x66475b4e8b85ecb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886743:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.886746:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886753:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.886758:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886767:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886777:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886785:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8cca181/0x66475b4e8b85ecc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1860:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886804:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.886805:0:190928:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+172:3314:x1869066299305984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4874us (5009us total) trans 8589940847 rc 0/0 00010000:00010000:2.0:1782487587.886809:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.886813:0:190928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16596 00010000:00010000:2.0:1782487587.886822:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.886827:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.886836:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782487587.886838:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c4700/2, rc 0, transno 8589940847 00000100:00100000:3.0:1782487587.886850:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299305984:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.886855:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.886864:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:3316:x1869066299304448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6835us (7271us total) trans 8589940848 rc 0/0 00010000:00010000:2.0:1782487587.886866:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4caed6b/0x66475b4e8b85ec9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.886882:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16590 00010000:00010000:2.0:1782487587.886895:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.886899:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.886902:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.886911:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.886919:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886934:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.886937:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eeb100/2, rc 0, transno 8589940848 00000100:00100000:2.0:1782487587.886948:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299304448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.886949:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886960:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.886973:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.887135:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+171:3315:x1869066299304960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5897us (6279us total) trans 8589940849 rc 0/0 00000100:00100000:1.0:1782487587.887142:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16592 00000004:00080000:3.0:1782487587.887155:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee8000/2, rc 0, transno 8589940849 00000100:00100000:3.0:1782487587.887161:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299304960:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.887166:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887174:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887182:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887201:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887224:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782487587.887245:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.887251:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887260:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.887264:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887275:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887337:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887348:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85eca9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887367:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.887371:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887379:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.887383:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+171:3315:x1869066299305856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5479us (5734us total) trans 8589940850 rc 0/0 00010000:00010000:2.0:1782487587.887385:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.887400:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16595 00010000:00010000:2.0:1782487587.887401:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887417:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887425:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ecbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1861:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887448:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.887452:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.887455:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.887468:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.887480:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299306624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.887530:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.887539:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.887541:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299307008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.887552:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299306752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887568:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.887593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.887594:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487587.887602:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299307136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.887646:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299307264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887649:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.887684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.887687:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299306624 00000100:00100000:2.0:1782487587.887692:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299306624 00000100:00100000:1.0:1782487587.887712:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.887722:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299307008 00000100:00100000:1.0:1782487587.887722:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299306880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887726:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299307008 00000100:00100000:2.0:1782487587.887752:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299306752 00000100:00100000:2.0:1782487587.887755:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299306752 00000100:00100000:1.0:1782487587.887759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.887788:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299307136 00000100:00100000:2.0:1782487587.887792:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299307136 00000100:00100000:2.0:1782487587.887815:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299307264 00000004:00080000:3.0:1782487587.887818:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb94380/2, rc 0, transno 8589940850 00000100:00100000:2.0:1782487587.887818:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299307264 00000100:00100000:3.0:1782487587.887837:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299305856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887846:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299306880 00000100:00100000:2.0:1782487587.887850:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299306880 00000100:00100000:3.0:1782487587.887874:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299307392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.887879:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16598 00000100:00100000:1.0:1782487587.887889:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16599 00000100:00100000:2.0:1782487587.887891:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+176:3316:x1869066299306624:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.887903:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+176:3316:x1869066299307008:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.887905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1782487587.887908:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6243 count 1 00002000:00080000:1.0:1782487587.887919:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6248 count 1 00010000:00010000:2.0:1782487587.887922:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887934:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887939:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 61 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887957:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1863:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.887961:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887963:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.887971:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.887977:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.887984:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.887989:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.887997:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 61 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888009:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888017:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888025:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299307520:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.888034:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.888048:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299307648:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.888077:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.888082:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.888097:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299307392 00000100:00100000:2.0:1782487587.888101:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299307392 00000100:00100000:2.0:1782487587.888135:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16600 00000100:00100000:2.0:1782487587.888146:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+177:3314:x1869066299306752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.888146:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16601 00002000:00080000:2.0:1782487587.888162:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6245 count 1 00000100:00100000:1.0:1782487587.888163:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+177:3316:x1869066299307136:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.888177:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.888183:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6247 count 1 00010000:00010000:2.0:1782487587.888204:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 61 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888209:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888217:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.888225:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.888231:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888232:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 61 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888252:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.888255:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.888259:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888266:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 61 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888279:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 61 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888288:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 61 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888295:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299307776:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.888296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.888308:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.888320:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444288 00000100:00100000:1.0:1782487587.888323:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299307904:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.888326:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444288 00000100:00100000:2.0:1782487587.888328:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.888349:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 62 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888353:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16602 00000100:00100000:1.0:1782487587.888356:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.888366:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+177:3314:x1869066299307264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.888379:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6249 count 1 00000100:00100000:0.0:1782487587.888384:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6497 00000100:00100000:1.0:1782487587.888385:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299306496:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.888390:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.888399:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+62:2360:x1869066294444288:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.888403:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888407:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 62 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888410:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.888421:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 62 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888428:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.888435:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.888441:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888443:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 62 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888471:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f61cc9/0x66475b4e8b85ba59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477938 expref: 62 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888475:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 62 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888495:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.888496:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888504:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.888515:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888516:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299308032:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.888530:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.888557:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.888558:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84540 going to sleep for 11 seconds 00010000:00010000:1.0:1782487587.888562:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888573:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888580:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16603 00000100:00100000:0.0:1782487587.888584:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+61:2360:x1869066294444288:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 187us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.888588:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888593:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+177:3314:x1869066299306880:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.888599:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6497 00010000:00010000:1.0:1782487587.888627:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.888630:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6244 count 1 00010000:00010000:2.0:1782487587.888645:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888647:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.888662:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 60 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888670:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.888673:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.888678:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888700:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 60 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888713:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 60 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888725:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299308160:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.888768:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84900 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.888782:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.888787:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888795:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.888800:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888809:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888823:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.888832:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85eccc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.888851:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+178:3316:x1869066299306368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2504us (2848us total) trans 8589940851 rc 0/0 00010000:00010000:2.0:1782487587.888853:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.888857:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.888862:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.888864:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16597 00000100:00100000:1.0:1782487587.888887:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16604 00000004:00080000:2.0:1782487587.888888:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c5c00/2, rc 0, transno 8589940851 00000100:00100000:1.0:1782487587.888898:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+177:3315:x1869066299307392:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.888902:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299306368:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.888913:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6251 count 1 00010000:00010000:1.0:1782487587.888928:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888943:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 63 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888951:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=2s v=(0 0) 00000100:00100000:2.0:1782487587.888955:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299308288:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.888956:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.888965:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.888989:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 63 pid: 213220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.888993:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.889007:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 63 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.889020:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299308416:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.889033:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299308288 00000100:00100000:2.0:1782487587.889037:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299308288 00000100:00100000:1.0:1782487587.889049:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.889065:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16605 00000100:00100000:2.0:1782487587.889074:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+178:3316:x1869066299308288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.889085:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6246 count 1 00010000:00010000:2.0:1782487587.889096:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.889108:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 60 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.889116:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.889120:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.889124:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.889156:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 60 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.889167:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 60 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.889197:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299308544:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.889235:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84600 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.890497:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299307520:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.890515:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.891181:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299308416:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.891213:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.891227:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299307776:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.891247:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.891255:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299307648:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.891273:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.891305:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299307904:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.891318:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.891386:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299308032:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.891403:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.891428:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299308160:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.891439:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.891462:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299308544:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.891476:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.891549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.891576:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.891576:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444544 00000100:00100000:0.0:1782487587.891583:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444544 00000100:00100000:3.0:1782487587.891599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.891632:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 64 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.891725:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444800 00000100:00100000:0.0:1782487587.891730:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444800 00010000:00010000:0.0:1782487587.891747:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 61 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.891769:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445056 00000100:00100000:0.0:1782487587.891773:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445056 00010000:00010000:0.0:1782487587.891789:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 62 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.891812:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6498 00000100:00100000:0.0:1782487587.891821:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+64:2360:x1869066294444544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.891832:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.891839:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 64 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.891851:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 64 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.891868:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001983520a/0x66475b4e8b85c4f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c4f expref: 64 pid: 213220 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.891880:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.891884:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.891888:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.891897:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.891904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487587.891929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.891932:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.891936:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.891946:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.891947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.891955:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.891962:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.891972:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2360:x1869066294444544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 151us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487587.891977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.891978:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.891986:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6498 00000100:00100000:0.0:1782487587.892005:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444416 00000100:00100000:0.0:1782487587.892009:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444416 00010000:00010000:0.0:1782487587.892025:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892041:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444672 00000100:00100000:0.0:1782487587.892044:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444672 00010000:00010000:0.0:1782487587.892057:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 64 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892067:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294444928 00000100:00100000:0.0:1782487587.892070:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294444928 00010000:00010000:0.0:1782487587.892083:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892097:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445184 00000100:00100000:0.0:1782487587.892099:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445184 00010000:00010000:0.0:1782487587.892113:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 66 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892129:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6499 00000100:00100000:0.0:1782487587.892137:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+66:2360:x1869066294444800:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.892145:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.892150:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 66 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892161:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 66 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892178:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279cfec5/0x66475b4e8b85bcc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1865:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779f5 expref: 66 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.892179:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+179:3315:x1869066299307392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3281us (4270us total) trans 8589940852 rc 0/0 00000100:00100000:3.0:1782487587.892201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.892205:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16604 00000004:00080000:2.0:1782487587.892210:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d91500/2, rc 0, transno 8589940852 00010000:00010000:0.0:1782487587.892214:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.892219:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1865:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.892223:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299307392:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.892225:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892227:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.892236:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892240:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892251:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.892258:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892267:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.892270:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782487587.892271:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.892283:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299308672:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.892285:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892295:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6e4bdfe/0x66475b4e8b85ecfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892302:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2360:x1869066294444800:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 163us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.892315:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6499 00000100:00100000:2.0:1782487587.892316:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.892317:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.892321:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.892324:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.892339:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299308672 00000100:00100000:0.0:1782487587.892340:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445312 00000100:00100000:1.0:1782487587.892343:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299308672 00000100:00100000:0.0:1782487587.892345:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445312 00010000:00010000:0.0:1782487587.892365:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 65 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.892376:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16606 00000100:00100000:0.0:1782487587.892386:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6500 00000100:00100000:1.0:1782487587.892387:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+179:3316:x1869066299308672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.892398:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+65:2360:x1869066294445056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00002000:00080000:1.0:1782487587.892404:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6250 count 1 00010000:00010000:0.0:1782487587.892407:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.892414:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892419:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892425:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892439:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 62 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892445:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000100baa1c/0x66475b4e8b85c1e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1869:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b8b expref: 65 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892452:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.892459:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.892462:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.892464:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892467:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.892476:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892485:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892492:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 62 pid: 213213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892502:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 62 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892509:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.892514:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299308800:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.892526:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.892537:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892540:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+64:2360:x1869066294445056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 144us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.892553:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.892554:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892558:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6500 00010000:00010000:2.0:1782487587.892568:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.892588:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.892593:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.892599:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892604:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6501 00010000:00010000:1.0:1782487587.892632:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6600 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.892637:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+63:2360:x1869066294444416:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.892638:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892648:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.892657:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892660:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892681:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892684:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892699:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001498ff11/0x66475b4e8b85ecef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892706:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2027d1/0x66475b4e8b85bc9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1863:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4779e0 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892719:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.892724:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.892727:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.892727:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.892732:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.892737:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892745:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892767:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.892776:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+180:3314:x1869066299307264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4412us (5090us total) trans 8589940853 rc 0/0 00000100:00100000:2.0:1782487587.892784:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16602 00000004:00080000:1.0:1782487587.892786:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c7b80/2, rc 0, transno 8589940853 00000100:00100000:1.0:1782487587.892800:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299307264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.892805:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+62:2360:x1869066294444416:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 169us (901us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.892807:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892821:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6501 00010000:00010000:2.0:1782487587.892831:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.892842:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.892846:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6502 00000100:00100000:1.0:1782487587.892849:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299308928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.892861:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+61:2360:x1869066294444672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.892862:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892875:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.892881:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.892883:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.892885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.892900:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892916:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bf6a274/0x66475b4e8b85c183 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1868:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b61 expref: 61 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892921:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.892929:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892934:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.892941:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.892942:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.892947:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892949:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.892970:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892971:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.892995:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893000:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.893006:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+180:3316:x1869066299306624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5118us (5491us total) trans 8589940854 rc 0/0 00010000:00010000:1.0:1782487587.893006:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001315c60e/0x66475b4e8b85ecd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893020:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16598 00000100:00100000:0.0:1782487587.893026:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+60:2360:x1869066294444672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 168us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.893036:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6502 00010000:00010000:1.0:1782487587.893037:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.893039:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299308928 00010000:00010000:1.0:1782487587.893041:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.893043:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299308928 00010000:00010000:1.0:1782487587.893045:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487587.893055:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6503 00010000:00010000:1.0:1782487587.893062:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.893068:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+59:2360:x1869066294444928:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.893072:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16607 00010000:00010000:1.0:1782487587.893081:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893084:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+180:3314:x1869066299308928:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.893084:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.893095:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 59 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893102:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.893103:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6253 count 1 00010000:00010000:0.0:1782487587.893115:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 59 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893116:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.893118:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893145:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a5e9170/0x66475b4e8b85c201 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1867:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b84 expref: 59 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.893149:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 62 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893153:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.893173:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782487587.893177:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.893178:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.893195:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.893202:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893202:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893225:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.893239:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 62 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893244:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.893253:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 62 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893268:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299309056:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.893269:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+58:2360:x1869066294444928:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 203us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.893280:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6503 00000100:00100000:0.0:1782487587.893295:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6504 00000100:00100000:0.0:1782487587.893304:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+57:2360:x1869066294445184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.893312:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84540 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.893314:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782487587.893316:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+181:3316:x1869066299307008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5416us (5747us total) trans 8589940855 rc 0/0 00010000:00010000:0.0:1782487587.893323:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 57 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.893328:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16599 00000004:00080000:2.0:1782487587.893338:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c7800/2, rc 0, transno 8589940855 00010000:00010000:0.0:1782487587.893341:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 57 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893349:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299307008:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.893361:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a692401/0x66475b4e8b85c271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1866:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477bbc expref: 57 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893362:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.893364:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c6a00/2, rc 0, transno 8589940854 00000100:00100000:2.0:1782487587.893374:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299306624:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.893386:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893399:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893399:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.893407:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.893419:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893420:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893424:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299309312:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.893444:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893452:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1782487587.893454:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.893461:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.893483:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+56:2360:x1869066294445184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 183us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.893488:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299309312 00000100:00100000:0.0:1782487587.893489:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6504 00000100:00100000:2.0:1782487587.893493:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299309312 00000100:00100000:0.0:1782487587.893506:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6505 00000100:00100000:0.0:1782487587.893514:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+55:2360:x1869066294445312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.893522:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782487587.893523:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16608 00010000:00010000:0.0:1782487587.893529:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 55 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893536:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+181:3316:x1869066299309312:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.893540:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 55 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893551:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467975c5/0x66475b4e8b85c191 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1864:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477b68 expref: 55 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.893553:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6252 count 1 00010000:00010000:0.0:1782487587.893567:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.893569:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893570:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.893578:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893599:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.893601:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+182:3316:x1869066299307136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5441us (5951us total) trans 8589940856 rc 0/0 00010000:00010000:2.0:1782487587.893634:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 62 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893636:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.893641:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16601 00010000:00010000:2.0:1782487587.893649:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=2s v=(0 0) 00000100:00100000:0.0:1782487587.893653:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+54:2360:x1869066294445312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 138us (1465us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.893654:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.893663:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.893665:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487587.893668:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6505 00010000:00010000:3.0:1782487587.893677:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.893677:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309184:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782487587.893687:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.893694:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 62 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.893698:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.893708:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.893712:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 62 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.893713:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893720:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893734:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.893740:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893741:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299309440:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487587.893745:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782487587.893745:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893762:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487587.893768:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893769:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.893785:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782487587.893793:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893800:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.893814:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782487587.893815:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893825:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d7b893/0x66475b4e8b85ecda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893838:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782487587.893842:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893848:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.893852:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893860:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893869:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893876:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4793502/0x66475b4e8b85ece8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893893:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.893897:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893904:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6000 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:3.0:1782487587.893906:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+182:3316:x1869066299308288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4833us (4915us total) trans 8589940857 rc 0/0 00010000:00010000:1.0:1782487587.893907:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.893913:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16605 00010000:00010000:1.0:1782487587.893916:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893925:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.893928:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299309184 00000100:00100000:3.0:1782487587.893931:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299309184 00010000:00010000:1.0:1782487587.893932:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1b626a3/0x66475b4e8b85ed04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893947:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.893950:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893957:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.893961:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893974:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.893985:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.893990:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb55afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+183:3314:x1869066299306752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5846us (6397us total) trans 8589940858 rc 0/0 00010000:00010000:1.0:1782487587.894002:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85ece1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.894004:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16600 00010000:00010000:1.0:1782487587.894028:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.894031:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.894035:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.894042:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee8380/2, rc 0, transno 8589940857 00010000:00010000:1.0:1782487587.894045:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.894054:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.894055:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299308288:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1782487587.894071:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c4e00/2, rc 0, transno 8589940856 00000100:00100000:2.0:1782487587.894077:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299307136:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.894086:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c5f80/2, rc 0, transno 8589940858 00000100:00100000:1.0:1782487587.894094:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299306752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.894114:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.894148:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.894161:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299309568:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.894179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.894183:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16609 00000100:00100000:3.0:1782487587.894204:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+182:3314:x1869066299309184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782487587.894216:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6254 count 1 00010000:00010000:3.0:1782487587.894229:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.894246:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 62 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.894253:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782487587.894256:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.894295:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.894322:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 62 pid: 200304 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.894332:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 62 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.894346:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299309952:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.894356:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.894363:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.894373:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.894374:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4545bea80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.894403:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.894403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.894415:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.894425:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.894434:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.894450:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.894881:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+183:3314:x1869066299306880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6290us (7123us total) trans 8589940859 rc 0/0 00000100:00100000:2.0:1782487587.894891:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16603 00000004:00080000:1.0:1782487587.894895:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb57f2c7100/2, rc 0, transno 8589940859 00000100:00100000:1.0:1782487587.894910:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299306880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.895002:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299309696 00000100:00100000:2.0:1782487587.895006:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299309696 00000100:00100000:2.0:1782487587.895029:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299309568 00000100:00100000:2.0:1782487587.895032:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299309568 00000100:00100000:2.0:1782487587.895057:0:213211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299309824 00000100:00100000:2.0:1782487587.895060:0:213211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299309824 00000100:00100000:1.0:1782487587.895066:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16610 00000100:00100000:1.0:1782487587.895079:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+185:3314:x1869066299309696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.895088:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16611 00002000:00080000:1.0:1782487587.895093:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6256 count 1 00000100:00100000:2.0:1782487587.895100:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+185:3317:x1869066299309568:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.895110:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.895114:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6255 count 1 00010000:00010000:1.0:1782487587.895129:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 62 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895131:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895146:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.895151:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.895155:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 62 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895157:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895174:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.895179:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.895183:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895204:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 62 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895217:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 62 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895221:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 62 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.895242:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299310080:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.895244:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 62 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.895259:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299310208:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.895297:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.895320:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16612 00000100:00100000:1.0:1782487587.895329:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+185:3314:x1869066299309824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.895342:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6257 count 1 00010000:00010000:1.0:1782487587.895355:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895368:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895376:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.895379:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.895383:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895404:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895416:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.895427:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299310336:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.895431:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.895455:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.895482:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.895491:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299310464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.895522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.895554:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.895559:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895568:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.895573:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299308800:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.895575:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895593:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895594:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.895595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.895633:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445440 00000100:00100000:0.0:1782487587.895637:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445440 00010000:00010000:0.0:1782487587.895654:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 63 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.895676:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6506 00000100:00100000:0.0:1782487587.895685:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2361:x1869066294445440:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.895693:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.895699:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 63 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.895715:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 63 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895720:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895731:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ecf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.895733:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a3cd378/0x66475b4e8b85c4fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477c48 expref: 63 pid: 213213 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.895755:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.895758:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.895762:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895766:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.895767:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895770:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.895776:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.895792:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.895798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.895801:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.895809:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.895818:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+62:2361:x1869066294445440:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.895819:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.895822:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299309056:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.895833:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6506 00010000:00010000:1.0:1782487587.895840:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895845:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.895849:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445568 00000100:00100000:0.0:1782487587.895854:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445568 00000100:00100000:3.0:1782487587.895860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.895869:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 62 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.895873:0:213384:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299310464 00000100:00100000:2.0:1782487587.895878:0:213384:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299310464 00000100:00100000:0.0:1782487587.895888:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445824 00000100:00100000:0.0:1782487587.895892:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445824 00000100:00100000:3.0:1782487587.895902:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299309952:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.895905:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 63 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.895910:0:213384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16613 00010000:00010000:3.0:1782487587.895919:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.895924:0:213384:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+186:3317:x1869066299310464:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.895932:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6507 00002000:00080000:2.0:1782487587.895942:0:213384:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6258 count 1 00000100:00100000:0.0:1782487587.895942:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+63:2360:x1869066294445568:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.895953:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.895957:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 63 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895959:0:213384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.895969:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 63 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895978:0:213384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 63 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.895982:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a08bc6/0x66475b4e8b85c756 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477cc6 expref: 63 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.895993:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.896001:0:213384:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.896009:0:213384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896009:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.896016:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.896024:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896030:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.896038:0:213384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 62 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896043:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.896052:0:213384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 62 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.896063:0:213384:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299310592:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.896077:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+62:2360:x1869066294445568:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.896086:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6507 00000100:00100000:2.0:1782487587.896096:0:213384:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84540 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.896115:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.896125:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6508 00010000:00010000:2.0:1782487587.896126:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.896137:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+61:2360:x1869066294445824:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.896139:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896150:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.896151:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896154:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.896160:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896198:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896213:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1f3871/0x66475b4e8b85c8c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d52 expref: 61 pid: 200304 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896227:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.896230:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.896234:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896241:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896261:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.896284:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+60:2360:x1869066294445824:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.896292:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6508 00010000:00010000:2.0:1782487587.896303:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.896313:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+187:3316:x1869066299308672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3928us (3999us total) trans 8589940860 rc 0/0 00000100:00100000:1.0:1782487587.896322:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16606 00010000:00010000:1.0:1782487587.896347:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.896353:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896361:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.896365:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896375:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896390:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.896396:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896398:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.896406:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.896415:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896421:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487587.896422:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896425:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896432:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.896436:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.896437:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.896444:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896455:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896463:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.896468:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+187:3314:x1869066299308928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3384us (3584us total) trans 8589940861 rc 0/0 00000100:00100000:2.0:1782487587.896484:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16607 00010000:00010000:1.0:1782487587.896492:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.896497:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896504:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.896508:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896521:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.896526:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed6d80/2, rc 0, transno 8589940860 00010000:00010000:1.0:1782487587.896533:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.896538:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299308672:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.896549:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031c5a27f/0x66475b4e8b85ed20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896565:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.896568:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.896571:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.896582:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.896591:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487587.896598:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+187:3314:x1869066299309184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2396us (2891us total) trans 8589940862 rc 0/0 00000100:00100000:2.0:1782487587.896599:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299310720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.896630:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16609 00000004:00080000:1.0:1782487587.896639:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed6a00/2, rc 0, transno 8589940862 00000100:00100000:1.0:1782487587.896650:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309184:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.896664:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d90e00/2, rc 0, transno 8589940861 00000100:00100000:1.0:1782487587.896669:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299308928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.896722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.896734:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299310848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.896745:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445696 00000100:00100000:0.0:1782487587.896751:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445696 00000100:00100000:1.0:1782487587.896764:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.896772:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 60 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.896790:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.896799:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299310976:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.896804:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6509 00000100:00100000:0.0:1782487587.896814:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+60:2360:x1869066294445696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.896823:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.896823:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.896830:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 60 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.896842:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 60 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.896844:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299310848 00000100:00100000:1.0:1782487587.896850:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299310848 00010000:00010000:0.0:1782487587.896859:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.896863:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.896866:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299310720 00010000:00010000:0.0:1782487587.896868:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.896871:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299310720 00010000:00010000:0.0:1782487587.896879:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.896883:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16614 00000100:00100000:1.0:1782487587.896895:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+188:3314:x1869066299310848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.896898:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1782487587.896909:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6260 count 1 00010000:00010000:1.0:1782487587.896921:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.896934:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+60:2360:x1869066294445696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 121us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.896935:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 53 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896950:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=2s v=(0 0) 00000100:00100000:0.0:1782487587.896950:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6509 00010000:00010000:1.0:1782487587.896957:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.896961:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.896984:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 53 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.896989:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16615 00010000:00010000:1.0:1782487587.897001:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 53 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.897003:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+188:3317:x1869066299310720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.897020:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6259 count 1 00000100:00100000:1.0:1782487587.897021:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299311104:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.897036:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897050:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 53 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897058:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.897062:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.897067:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447480 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.897068:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897094:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 53 pid: 213226 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.897096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.897110:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 53 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.897123:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299311232:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.897242:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299310976 00000100:00100000:1.0:1782487587.897247:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299310976 00000100:00100000:1.0:1782487587.897281:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16616 00000100:00100000:2.0:1782487587.897289:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84300 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.897291:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+189:3314:x1869066299310976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.897305:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6261 count 1 00010000:00010000:1.0:1782487587.897318:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.897331:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 53 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897339:0:190930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e23b4789/0x66475b4e8b85c84b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d3d expref: 59 pid: 190931 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.897341:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.897350:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.897357:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.897362:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299309440:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.897384:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.897386:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 53 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897404:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.897409:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 53 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897421:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.897432:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299311360:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.897433:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897445:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.897462:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.897465:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.897716:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+190:3316:x1869066299309312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4183us (4260us total) trans 8589940863 rc 0/0 00000100:00100000:2.0:1782487587.897723:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16608 00010000:00010000:2.0:1782487587.897743:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.897749:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897757:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.897761:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897770:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897784:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897792:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.897811:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.897814:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.897818:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.897839:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed5180/2, rc 0, transno 8589940863 00000100:00100000:2.0:1782487587.897850:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299309312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.897894:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.897902:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299311488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.897928:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.897955:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299311488 00000100:00100000:1.0:1782487587.897960:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299311488 00000100:00100000:2.0:1782487587.897993:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16617 00000100:00100000:2.0:1782487587.898004:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb48eed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+190:3317:x1869066299311488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.898017:0:213223:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6262 count 1 00010000:00010000:2.0:1782487587.898030:0:213223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.898042:0:213223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 53 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.898050:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.898054:0:213223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.898058:0:213223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.898077:0:213223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 53 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.898088:0:213223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.898100:0:213223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299311616:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.898136:0:213223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.898788:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299310080:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.898807:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.898842:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299310336:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.898857:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.898880:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:213211:1869066299310208:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.898901:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.898913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.898939:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446080 00000100:00100000:3.0:1782487587.898940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.898946:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446080 00000100:00100000:3.0:1782487587.898961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.898971:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 59 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899001:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446208 00000100:00100000:0.0:1782487587.899004:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446208 00010000:00010000:0.0:1782487587.899019:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 60 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.899031:0:213384:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:213384:1869066299310592:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.899043:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294445952 00010000:00010000:2.0:1782487587.899048:0:213384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899048:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294445952 00000100:00100000:1.0:1782487587.899058:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299311104:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.899061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.899066:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 61 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899074:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.899086:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.899102:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446336 00000100:00100000:0.0:1782487587.899107:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446336 00010000:00010000:0.0:1782487587.899121:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 62 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899138:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446464 00000100:00100000:0.0:1782487587.899141:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446464 00010000:00010000:0.0:1782487587.899153:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 54 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899172:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6510 00000100:00100000:0.0:1782487587.899180:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+62:2362:x1869066294446080:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.899201:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.899208:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899220:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899236:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4f3571/0x66475b4e8b85cc42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1871:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e1d expref: 62 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899249:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899253:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899260:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899268:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899288:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.899318:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+61:2362:x1869066294446080:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 139us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.899326:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6510 00000100:00100000:0.0:1782487587.899342:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6511 00000100:00100000:0.0:1782487587.899348:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+60:2360:x1869066294446208:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.899356:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.899360:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 60 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899370:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 60 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899384:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026dcdd59/0x66475b4e8b85c8e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x186f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477d59 expref: 60 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899386:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899403:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899403:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899411:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899420:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899421:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899443:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899450:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899463:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.899480:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.899501:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899512:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+59:2360:x1869066294446208:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (568us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.899515:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899529:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6511 00010000:00010000:2.0:1782487587.899530:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.899541:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899551:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6512 00010000:00010000:2.0:1782487587.899557:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1782487587.899562:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+58:2360:x1869066294445952:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.899572:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.899578:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 58 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899591:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 58 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899635:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008749ba9/0x66475b4e8b85caeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1870:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477de5 expref: 58 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899646:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899650:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899654:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899667:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.899674:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+191:3314:x1869066299309824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4344us (5270us total) trans 8589940864 rc 0/0 00000100:00100000:1.0:1782487587.899687:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16612 00010000:00010000:0.0:1782487587.899692:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.899709:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487587.899715:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899723:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+57:2360:x1869066294445952:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 162us (758us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.899726:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.899733:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899733:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6512 00010000:00010000:1.0:1782487587.899745:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899753:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6513 00010000:00010000:1.0:1782487587.899761:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.899763:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+56:2361:x1869066294446336:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.899776:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85ed35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899777:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.899786:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 56 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899799:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.899800:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 56 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899805:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899818:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.899822:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899823:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8339e56/0x66475b4e8b85cc34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1872:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477e0f expref: 56 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899851:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899851:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899859:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.899869:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.899873:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.899890:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+191:3317:x1869066299309568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4791us (5533us total) trans 8589940865 rc 0/0 00010000:00010000:1.0:1782487587.899895:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.899902:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.899906:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16611 00010000:00010000:1.0:1782487587.899928:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.899931:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.899932:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.899934:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.899937:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.899956:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed4a80/2, rc 0, transno 8589940865 00000100:00100000:2.0:1782487587.899967:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299309568:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.899967:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed7480/2, rc 0, transno 8589940864 00000100:00100000:0.0:1782487587.899970:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+55:2361:x1869066294446336:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 208us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.899979:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.899985:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6513 00010000:00010000:1.0:1782487587.900003:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.900008:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6514 00010000:00010000:1.0:1782487587.900017:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.900022:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+54:2361:x1869066294446464:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.900034:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.900035:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.900044:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 54 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900047:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.900067:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 54 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.900074:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782487587.900077:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.900084:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f561974e/0x66475b4e8b85cf2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1874:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f19 expref: 54 pid: 192482 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.900095:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.900099:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.900103:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.900115:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.900133:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.900158:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2361:x1869066294446464:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 141us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.900165:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6514 00000100:00100000:1.0:1782487587.900216:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+191:3314:x1869066299309696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5139us (6036us total) trans 8589940866 rc 0/0 00000100:00100000:1.0:1782487587.900223:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16610 00010000:00010000:1.0:1782487587.900249:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.900254:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900263:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:2.0:1782487587.900264:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299311744:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.900270:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900282:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900296:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900304:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900322:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.900325:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.900328:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.900341:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.900349:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.900356:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900365:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900372:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900390:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.900396:0:213384:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900407:0:213384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900416:0:213384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900424:0:213384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900438:0:213384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.900636:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+192:3314:x1869066299310848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3742us (3872us total) trans 8589940867 rc 0/0 00000100:00100000:1.0:1782487587.900645:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16614 00000100:00100000:1.0:1782487587.900664:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299311744 00000100:00100000:1.0:1782487587.900668:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299311744 00000100:00100000:1.0:1782487587.900697:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16618 00000100:00100000:1.0:1782487587.900705:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+192:3317:x1869066299311744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.900722:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6264 count 1 00010000:00010000:1.0:1782487587.900737:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900751:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 52 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900760:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.900764:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.900769:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.900792:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 52 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.900795:0:213384:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+192:3317:x1869066299310464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4873us (5271us total) trans 8589940868 rc 0/0 00000100:00100000:2.0:1782487587.900812:0:213384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16613 00010000:00010000:1.0:1782487587.900813:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 52 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.900828:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299312000:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.900836:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487587.900842:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900852:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.900857:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900867:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.900876:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.900882:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900892:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e9a3f4/0x66475b4e8b85ed43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900914:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.900918:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900926:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.900931:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900940:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900953:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900961:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.900982:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.900986:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.900990:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.901020:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed5500/2, rc 0, transno 8589940868 00000100:00100000:2.0:1782487587.901031:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299310464:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.901108:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb543521880/2, rc 0, transno 8589940867 00000100:00100000:1.0:1782487587.901117:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb543521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299310848:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.901132:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed4380/2, rc 0, transno 8589940866 00000100:00100000:1.0:1782487587.901138:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299309696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.901145:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.901156:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299312128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.901199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.901236:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.901251:0:213221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299312128 00000100:00100000:1.0:1782487587.901255:0:213221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299312128 00000100:00100000:1.0:1782487587.901287:0:213221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16619 00000100:00100000:1.0:1782487587.901296:0:213221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+192:3314:x1869066299312128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.901309:0:213221:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6267 count 1 00010000:00010000:1.0:1782487587.901322:0:213221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901337:0:213221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901345:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.901348:0:213221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.901352:0:213221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901373:0:213221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901386:0:213221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.901399:0:213221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb558a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299312256:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.901411:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299312512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.901429:0:213221:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.901445:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.901474:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782487587.901481:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299312384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.901507:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487587.901536:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299311872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.901565:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299312512 00000100:00100000:3.0:1782487587.901571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.901571:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299312512 00000100:00100000:2.0:1782487587.901807:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299312384 00000100:00100000:2.0:1782487587.901813:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299312384 00000100:00100000:2.0:1782487587.901844:0:190930:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299311872 00000100:00100000:2.0:1782487587.901847:0:190930:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299311872 00000100:00100000:1.0:1782487587.901869:0:195192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16620 00000100:00100000:2.0:1782487587.901877:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16621 00000100:00100000:1.0:1782487587.901882:0:195192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+195:3317:x1869066299312512:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.901890:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb450ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+195:3317:x1869066299312384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.901898:0:195192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6263 count 1 00002000:00080000:2.0:1782487587.901904:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6265 count 1 00010000:00010000:1.0:1782487587.901913:0:195192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.901921:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901929:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 52 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.901939:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 52 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901956:0:195192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 54 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.901957:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.901965:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.901975:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.901975:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.901983:0:195192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.901991:0:195192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.902015:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:190931:1869066299311232:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.902017:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 54 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.902028:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.902032:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 54 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.902037:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.902044:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299312640:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.902051:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446592 00000100:00100000:0.0:1782487587.902057:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446592 00000100:00100000:3.0:1782487587.902061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1782487587.902067:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16622 00000100:00100000:2.0:1782487587.902077:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+195:3315:x1869066299311872:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.902082:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 53 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.902092:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6268 count 1 00010000:00010000:1.0:1782487587.902096:0:195192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 53 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.902100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.902105:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902109:0:195192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 53 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.902110:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446848 00000100:00100000:0.0:1782487587.902114:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446848 00010000:00010000:2.0:1782487587.902127:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 54 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902129:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 54 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.902130:0:195192:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb57f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299312768:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.902151:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.902156:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1782487587.902159:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446720 00010000:00010000:2.0:1782487587.902160:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.902163:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446720 00010000:00010000:0.0:1782487587.902173:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 55 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.902174:0:195192:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534479c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.902185:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 54 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.902207:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6515 00000100:00100000:1.0:1782487587.902215:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299311360:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.902217:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+55:2361:x1869066294446592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.902228:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782487587.902233:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902234:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 55 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902255:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 55 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902267:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b188a98/0x66475b4e8b85cf05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1873:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477f0b expref: 55 pid: 213226 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902276:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.902279:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.902282:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902287:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902305:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.902334:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+54:2361:x1869066294446592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 119us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.902342:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6515 00000100:00100000:0.0:1782487587.902365:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6516 00010000:00010000:2.0:1782487587.902366:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 54 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.902377:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2361:x1869066294446848:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487587.902384:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299312896:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.902386:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.902394:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.902400:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.902422:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902425:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.902438:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902446:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.902447:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902455:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.902463:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902474:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902487:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.902506:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+53:2361:x1869066294446848:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 134us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.902514:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6516 00000100:00100000:0.0:1782487587.902531:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6517 00000100:00100000:0.0:1782487587.902539:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+52:2360:x1869066294446720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.902546:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.902550:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 52 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902560:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 52 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902576:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006e0d36/0x66475b4e8b85ce79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1875:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a477ecc expref: 52 pid: 213222 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902582:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.902584:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.902587:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.902592:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.902729:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.902734:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487587.902735:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.902741:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902750:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7000 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.902754:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.902760:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+51:2360:x1869066294446720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 222us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.902768:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6517 00010000:00010000:1.0:1782487587.902786:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902801:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902816:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993f425/0x66475b4e8b85ed4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902839:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.902843:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.902847:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.902860:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902873:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902882:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902890:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.902907:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.902934:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+196:3317:x1869066299310720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5933us (6110us total) trans 8589940869 rc 0/0 00000100:00100000:2.0:1782487587.902943:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16615 00000004:00080000:2.0:1782487587.902990:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed6680/2, rc 0, transno 8589940869 00000100:00100000:2.0:1782487587.903000:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299310720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.903074:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487587.903092:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+196:3314:x1869066299310976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5802us (5997us total) trans 8589940870 rc 0/0 00000100:00100000:1.0:1782487587.903100:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16616 00010000:00010000:1.0:1782487587.903123:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.903128:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.903136:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.903140:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.903149:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.903163:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.903171:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82e59c8/0x66475b4e8b85ed51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.903200:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.903203:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.903206:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.903232:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb549183800/2, rc 0, transno 8589940870 00000100:00100000:1.0:1782487587.903238:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299310976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.904109:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487587.904123:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299313152:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782487587.904125:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 50 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904142:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 50 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.904157:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299313280:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.904164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.904387:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782487587.904408:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299313152 00000100:00100000:2.0:1782487587.904412:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299313152 00000100:00100000:3.0:1782487587.904420:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299313024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.904447:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16623 00000100:00100000:3.0:1782487587.904455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.904460:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+196:3314:x1869066299313152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.904476:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6270 count 1 00010000:00010000:2.0:1782487587.904491:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904505:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904513:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.904517:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.904522:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904542:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904553:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.904572:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299313408:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.904598:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84480 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.904603:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299313024 00000100:00100000:1.0:1782487587.904657:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299313024 00000100:00100000:2.0:1782487587.904685:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84300 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.904696:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16624 00000100:00100000:1.0:1782487587.904706:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+197:3315:x1869066299313024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782487587.904719:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6266 count 1 00010000:00010000:2.0:1782487587.904725:0:213223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c18462/0x66475b4e8b85d422 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1876:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47808c expref: 50 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904732:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.904742:0:213223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:213223:1869066299311616:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.904749:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 49 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904758:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782487587.904761:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.904765:0:213223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904766:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904787:0:213223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904796:0:213223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904802:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 49 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904807:0:213223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904821:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 49 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904822:0:213223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.904850:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299313536:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.904852:0:213223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.904867:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.904872:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904880:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6800 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:1.0:1782487587.904884:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.904885:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904896:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904912:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.904919:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:213222:1869066299312000:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.904922:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4786c2/0x66475b4e8b85ed58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.904942:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.904946:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.904951:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.904957:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487587.904983:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb4add2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299312640:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487587.905007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.905013:0:213221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb558a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:213221:1869066299312256:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.905028:0:213221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905030:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294446976 00000100:00100000:0.0:1782487587.905035:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294446976 00010000:00010000:0.0:1782487587.905058:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 50 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905088:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6518 00000100:00100000:0.0:1782487587.905098:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+50:2360:x1869066294446976:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.905106:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.905110:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 50 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905121:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 50 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905134:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b0059e2/0x66475b4e8b85d484 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1878:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780c4 expref: 50 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905143:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.905146:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.905149:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905155:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905173:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb48eed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+198:3317:x1869066299311488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7170us (7243us total) trans 8589940871 rc 0/0 00010000:00010000:0.0:1782487587.905176:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.905182:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905184:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16617 00010000:00010000:1.0:1782487587.905205:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.905216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.905217:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+49:2360:x1869066294446976:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 119us (209us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.905224:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905226:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6518 00010000:00010000:1.0:1782487587.905235:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905239:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447232 00000100:00100000:0.0:1782487587.905242:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447232 00010000:00010000:1.0:1782487587.905252:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782487587.905254:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905276:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6519 00000100:00100000:0.0:1782487587.905283:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+55:2360:x1869066294447232:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.905290:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.905293:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905300:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905313:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa69fbb/0x66475b4e8b85d889 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ff expref: 55 pid: 213223 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905325:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.905345:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2360:x1869066294447232:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.905353:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6519 00000004:00080000:2.0:1782487587.905372:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed7100/2, rc 0, transno 8589940871 00000100:00100000:2.0:1782487587.905384:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299311488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.905415:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+198:3317:x1869066299311744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4709us (5068us total) trans 8589940872 rc 0/0 00000100:00100000:1.0:1782487587.905424:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16618 00000004:00080000:2.0:1782487587.905447:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eebb80/2, rc 0, transno 8589940872 00010000:00010000:1.0:1782487587.905449:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.905456:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905458:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299311744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.905468:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782487587.905471:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.905476:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905479:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb450eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299313664:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.905492:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.905508:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905515:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782487587.905523:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea92b92/0x66475b4e8b85ed5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.905548:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.905551:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.905555:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.905557:0:213210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299313664 00000100:00100000:2.0:1782487587.905561:0:213210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299313664 00000100:00100000:2.0:1782487587.905592:0:213210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16625 00000100:00100000:2.0:1782487587.905601:0:213210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+198:3317:x1869066299313664:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782487587.905624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1782487587.905630:0:195192:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb57f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:195192:1869066299312768:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.905640:0:190284:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447360 00000100:00100000:0.0:1782487587.905644:0:190284:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447360 00010000:00010000:1.0:1782487587.905649:0:195192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905656:0:190284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905678:0:190284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6520 00000100:00100000:0.0:1782487587.905686:0:190284:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+49:2361:x1869066294447360:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.905694:0:190284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.905699:0:190284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905715:0:190284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905730:0:190284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856c64a5/0x66475b4e8b85d429 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1877:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780a1 expref: 49 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905741:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.905746:0:190284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1877:0x0].0x0 since=0s v=(0 0) 00002000:00080000:2.0:1782487587.905751:0:213210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6269 count 1 00010000:00010000:0.0:1782487587.905751:0:190284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905761:0:190284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.905767:0:213210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.905781:0:213210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 48 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905782:0:190284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.905787:0:195192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.905793:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.905801:0:213210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.905803:0:195192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905806:0:190284:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+48:2361:x1869066294447360:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 120us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.905810:0:213210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.905821:0:190284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6520 00010000:00010000:1.0:1782487587.905831:0:195192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.905839:0:195192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.905847:0:213210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 47 pid: 190930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.905852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.905855:0:195192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.905866:0:213210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 47 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905878:0:213210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299313792:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.905902:0:192468:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447104 00000100:00100000:0.0:1782487587.905906:0:192468:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447104 00010000:00010000:0.0:1782487587.905923:0:192468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905925:0:213210:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.905946:0:192468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6521 00000100:00100000:0.0:1782487587.905953:0:192468:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+54:2361:x1869066294447104:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.905960:0:192468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.905964:0:192468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.905968:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299313920:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487587.905974:0:192468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905986:0:192468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed1a89e6/0x66475b4e8b85d79b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781ab expref: 54 pid: 213225 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.905995:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.905998:0:192468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.906001:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782487587.906004:0:192468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.906010:0:192468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.906021:0:195192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+199:3317:x1869066299312512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4141us (4574us total) trans 8589940873 rc 0/0 00010000:00010000:0.0:1782487587.906025:0:192468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487587.906031:0:195192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16620 00000004:00080000:2.0:1782487587.906037:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee8e00/2, rc 0, transno 8589940873 00000100:00100000:0.0:1782487587.906044:0:192468:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2361:x1869066294447104:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487587.906050:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299312512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.906050:0:195192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299313920 00000100:00100000:1.0:1782487587.906056:0:195192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299313920 00000100:00100000:0.0:1782487587.906057:0:192468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6521 00000100:00100000:2.0:1782487587.906090:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16626 00000100:00100000:2.0:1782487587.906100:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+199:3317:x1869066299313920:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.906104:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.906111:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782487587.906112:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6271 count 1 00010000:00010000:1.0:1782487587.906124:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.906127:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906129:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906151:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906153:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906174:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.906178:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.906179:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906183:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906199:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7ebc74/0x66475b4e8b85ed6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 195192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906213:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.906215:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.906216:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.906228:0:213221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906236:0:213221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906243:0:213221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906251:0:213221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906261:0:213221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487587.906355:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906367:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.906386:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299314048:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487587.906428:0:213221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+200:3314:x1869066299312128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5132us (5238us total) trans 8589940874 rc 0/0 00000100:00100000:2.0:1782487587.906431:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84780 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.906439:0:213221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16619 00010000:00010000:1.0:1782487587.906462:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.906468:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906476:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.906480:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906489:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906505:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.906509:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:213693:1869066299313408:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.906521:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add8bde8/0x66475b4e8b85ed66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906533:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906545:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.906550:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.906554:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.906559:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487587.906569:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299314176:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782487587.906584:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee9180/2, rc 0, transno 8589940874 00000100:00100000:2.0:1782487587.906602:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487587.906604:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299312128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782487587.906704:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:213220:1869066299313536:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.906718:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.906795:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487587.906800:0:213213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299314176 00000100:00100000:2.0:1782487587.906805:0:213213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299314176 00000100:00100000:1.0:1782487587.906808:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299314304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.906844:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16627 00000100:00100000:1.0:1782487587.906845:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487587.906857:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+200:3315:x1869066299314176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.906870:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6274 count 1 00000100:00100000:3.0:1782487587.906871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.906884:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.906884:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299314304 00000100:00100000:1.0:1782487587.906890:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299314304 00000100:00100000:0.0:1782487587.906893:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447616 00000100:00100000:0.0:1782487587.906898:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447616 00010000:00010000:2.0:1782487587.906901:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 52 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.906908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487587.906915:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.906917:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=2s v=(0 0) 00000100:00100000:1.0:1782487587.906921:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16628 00010000:00010000:2.0:1782487587.906925:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487587.906933:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+201:3314:x1869066299314304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.906934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.906936:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487587.906953:0:213228:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6273 count 1 00000100:00100000:3.0:1782487587.906958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.906968:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447488 00010000:00010000:1.0:1782487587.906969:0:213228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.906973:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447488 00010000:00010000:2.0:1782487587.906981:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 53 pid: 213211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.906986:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 48 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.906988:0:213228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 53 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907005:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 53 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907013:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=2s v=(0 0) 00000100:00100000:0.0:1782487587.907013:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447872 00000100:00100000:0.0:1782487587.907017:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447872 00010000:00010000:1.0:1782487587.907023:0:213228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1782487587.907027:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299314432:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.907029:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 49 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907030:0:213228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907061:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294447744 00000100:00100000:0.0:1782487587.907065:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294447744 00010000:00010000:1.0:1782487587.907073:0:213228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 53 pid: 213224 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907080:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 50 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907086:0:213228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 53 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487587.907104:0:213228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299314560:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487587.907108:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6522 00000100:00100000:0.0:1782487587.907116:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2361:x1869066294447616:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.907122:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.907126:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907133:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 53 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907142:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907144:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907147:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907151:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907161:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782487587.907173:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84480 going to sleep for 11 seconds 00000100:00100000:1.0:1782487587.907174:0:213228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782487587.907179:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+53:2361:x1869066294447616:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 62us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.907198:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6522 00000100:00100000:0.0:1782487587.907216:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6523 00000100:00100000:0.0:1782487587.907221:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+50:2360:x1869066294447488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.907227:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.907232:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907240:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.907244:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb55afd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:190930:1869066299313280:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.907259:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c22069a/0x66475b4e8b85d819 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c7 expref: 50 pid: 213693 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907268:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907270:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907281:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907284:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907291:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907308:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.907331:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+49:2360:x1869066294447488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 108us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.907338:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6523 00000100:00100000:0.0:1782487587.907356:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6524 00000100:00100000:0.0:1782487587.907364:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+48:2361:x1869066294447872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.907372:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.907378:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 48 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.907384:0:213210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:213210:1869066299313792:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.907396:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 48 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907404:0:213210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907414:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001962cc79/0x66475b4e8b85d644 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47813b expref: 48 pid: 195192 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907429:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907431:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907435:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907444:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907447:0:213227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501e128d/0x66475b4e8b85d794 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47817a expref: 52 pid: 213210 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.907465:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:213227:1869066299312896:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487587.907467:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487587.907468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:1.0:1782487587.907475:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907486:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907487:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907492:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+47:2361:x1869066294447872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 127us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.907509:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6524 00010000:00010000:1.0:1782487587.907512:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907522:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448000 00000100:00100000:0.0:1782487587.907528:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448000 00010000:00010000:1.0:1782487587.907531:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907541:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 47 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.907546:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:213224:1869066299314048:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.907547:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487587.907550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.907568:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448128 00010000:00010000:2.0:1782487587.907569:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907571:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448128 00010000:00010000:0.0:1782487587.907583:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907589:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907597:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6525 00010000:00010000:2.0:1782487587.907600:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907628:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+47:2360:x1869066294447744:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.907633:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.907636:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 47 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907644:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 47 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907657:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3ac9153/0x66475b4e8b85d430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1879:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47809a expref: 47 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907664:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907666:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907669:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907677:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907697:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.907708:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907717:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907724:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+46:2360:x1869066294447744:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 116us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487587.907729:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+202:3315:x1869066299313024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3022us (3273us total) trans 8589940875 rc 0/0 00000100:00100000:0.0:1782487587.907737:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6525 00010000:00010000:2.0:1782487587.907739:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1782487587.907744:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16624 00010000:00010000:2.0:1782487587.907752:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1782487587.907752:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6526 00010000:00010000:2.0:1782487587.907760:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907764:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+45:2360:x1869066294448000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487587.907768:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.907777:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.907778:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907778:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.907781:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907786:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 45 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907804:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.907812:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907812:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 45 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907820:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907840:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907850:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907860:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000672ddcc3/0x66475b4e8b85d80b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781c0 expref: 45 pid: 190930 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.907869:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907874:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e291fc/0x66475b4e8b85ed89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907881:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.907889:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487587.907897:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0c57bc/0x66475b4e8b85ed7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907897:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907910:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.907914:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.907916:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907919:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.907930:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.907933:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.907934:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.907936:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487587.907937:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.907947:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.907955:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907960:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:838f7623-bf1c-484f-8afd-fb26a1863ad0+44:2360:x1869066294448000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 197us (495us total) trans 0 rc 0/0 00010000:00010000:2.0:1782487587.907971:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.907974:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6526 00000100:00100000:0.0:1782487587.907995:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6527 00010000:00010000:2.0:1782487587.907996:0:213210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.908004:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+52:2360:x1869066294448128:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487587.908007:0:213210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908011:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.908020:0:213210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908020:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908043:0:213210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908048:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908071:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000335bee1/0x66475b4e8b85dc1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x187f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4782d1 expref: 52 pid: 213228 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908081:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.908084:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.908088:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908096:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908109:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.908124:0:213210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.908130:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782487587.908130:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+51:2360:x1869066294448128:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 128us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.908138:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6527 00010000:00010000:1.0:1782487587.908139:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908149:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.908153:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908167:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908182:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908203:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009427a663/0x66475b4e8b85ed90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908222:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.908225:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.908229:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.908412:0:213210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+202:3317:x1869066299313664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2812us (2899us total) trans 8589940876 rc 0/0 00000100:00100000:2.0:1782487587.908420:0:213210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16625 00000100:00100000:2.0:1782487587.908459:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299314432:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.908474:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908494:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908502:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908511:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908520:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908633:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487587.908642:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.908648:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908656:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.908660:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782487587.908663:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed5c00/2, rc 0, transno 8589940875 00010000:00010000:1.0:1782487587.908673:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.908677:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299313024:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.908694:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908708:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1626684/0x66475b4e8b85ed97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.908732:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.908735:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.908738:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487587.908751:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.908773:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+202:3317:x1869066299313920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2673us (2771us total) trans 8589940877 rc 0/0 00000100:00100000:2.0:1782487587.908781:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16626 00000100:00100000:0.0:1782487587.908790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:2.0:1782487587.908806:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.908813:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.908816:0:213392:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448256 00000100:00100000:0.0:1782487587.908821:0:213392:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448256 00010000:00010000:2.0:1782487587.908824:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.908830:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908838:0:213392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 51 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908839:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.908865:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.908873:0:213392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6528 00010000:00010000:2.0:1782487587.908876:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e438c25/0x66475b4e8b85ed74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.908884:0:213392:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+51:2360:x1869066294448256:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487587.908891:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb450ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+202:3317:x1869066299312384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7002us (7381us total) trans 8589940878 rc 0/0 00010000:00010000:0.0:1782487587.908894:0:213392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487587.908898:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.908902:0:213392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 51 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.908903:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16621 00010000:00010000:2.0:1782487587.908903:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.908909:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487587.908918:0:213392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 51 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908931:0:213392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032cda470/0x66475b4e8b85e20d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478483 expref: 51 pid: 213211 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.908932:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.908950:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908952:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.908959:0:213392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487587.908964:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908965:0:213392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487587.908986:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.908986:0:213392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.909015:0:213392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1782487587.909019:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d93800/2, rc 0, transno 8589940877 00010000:00010000:3.0:1782487587.909022:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.909027:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299313920:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.909027:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.909035:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.909038:0:213392:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2360:x1869066294448256:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 157us (248us total) trans 0 rc 0/0 00000004:00080000:2.0:1782487587.909043:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eea680/2, rc 0, transno 8589940876 00000100:00100000:2.0:1782487587.909051:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299313664:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.909055:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c6a00 already unused, calling callback (ffffffffc1792ce0) 00000100:00100000:0.0:1782487587.909057:0:213392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6528 00010000:00010000:1.0:1782487587.909063:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782487587.909068:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450ee9500/2, rc 0, transno 8589940878 00010000:00010000:1.0:1782487587.909073:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.909075:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299312384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.909088:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782487587.909093:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.909097:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299314688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782487587.909108:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000837fd4e8/0x66475b4e8b85ed82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.909127:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.909130:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.909135:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487587.909139:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487587.909177:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.909202:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb558a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+202:3314:x1869066299313152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4746us (5041us total) trans 8589940879 rc 0/0 00000100:00100000:3.0:1782487587.909210:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16623 00000004:00080000:1.0:1782487587.909212:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb48eed7800/2, rc 0, transno 8589940879 00000100:00100000:1.0:1782487587.909217:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb48eed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299313152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.909230:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299314688 00000100:00100000:3.0:1782487587.909234:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299314688 00010000:00010000:2.0:1782487587.909281:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909331:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909340:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909356:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782487587.909510:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+203:3315:x1869066299314176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2655us (2910us total) trans 8589940880 rc 0/0 00000100:00100000:2.0:1782487587.909521:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16627 00000100:00100000:2.0:1782487587.909542:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16629 00000100:00100000:2.0:1782487587.909551:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+202:3317:x1869066299314688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782487587.909567:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6272 count 1 00010000:00010000:2.0:1782487587.909580:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909593:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909601:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782487587.909624:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487587.909629:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909649:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909661:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487587.909673:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299314816:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487587.909712:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe849c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782487587.909726:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.909731:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909740:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.909745:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909754:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909768:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909777:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd53b040/0x66475b4e8b85ed9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.909797:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.909799:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.909803:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.910347:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb94a80/2, rc 0, transno 8589940880 00000100:00100000:2.0:1782487587.910354:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299314176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.910532:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+203:3315:x1869066299311872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8456us (8960us total) trans 8589940881 rc 0/0 00000100:00100000:3.0:1782487587.910539:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16622 00000004:00080000:2.0:1782487587.910562:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb450eead80/2, rc 0, transno 8589940881 00000100:00100000:2.0:1782487587.910569:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb450eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299311872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782487587.910670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.910697:0:192528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448384 00000100:00100000:0.0:1782487587.910702:0:192528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448384 00010000:00010000:0.0:1782487587.910722:0:192528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 50 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.910743:0:192528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6529 00000100:00100000:0.0:1782487587.910748:0:192528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2360:x1869066294448384:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.910754:0:192528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.910758:0:192528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 50 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.910765:0:192528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 50 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.910775:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.910778:0:192528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.910781:0:192528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.910786:0:192528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.910795:0:192528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487587.910813:0:192528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+50:2360:x1869066294448384:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 66us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487587.910818:0:213228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027aa61a5/0x66475b4e8b85e1ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1881:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478475 expref: 50 pid: 213224 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.910820:0:192528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6529 00000100:00100000:1.0:1782487587.910836:0:213228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:213228:1869066299314560:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487587.910853:0:213228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.910863:0:213228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.910871:0:213228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.910881:0:213228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.910889:0:213228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.910904:0:213228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782487587.911058:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+203:3314:x1869066299314304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4127us (4217us total) trans 8589940882 rc 0/0 00000100:00100000:1.0:1782487587.911063:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16628 00010000:00010000:1.0:1782487587.911082:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487587.911086:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.911092:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487587.911096:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.911102:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.911112:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.911117:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002edd8db4/0x66475b4e8b85eda5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487587.911132:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.911134:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487587.911137:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487587.911155:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb97480/2, rc 0, transno 8589940882 00000100:00100000:1.0:1782487587.911159:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299314304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782487587.913592:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:213213:1869066299314816:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487587.913635:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487587.913751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487587.913777:0:192469:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448512 00000100:00100000:0.0:1782487587.913782:0:192469:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448512 00010000:00010000:0.0:1782487587.913802:0:192469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487587.913823:0:192469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6530 00000100:00100000:0.0:1782487587.913829:0:192469:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+49:2361:x1869066294448512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487587.913836:0:192469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487587.913840:0:192469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.913850:0:192469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.913862:0:192469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafe209c/0x66475b4e8b85e1f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1880:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47846e expref: 49 pid: 190928 timeout: 7315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.913872:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.913874:0:192469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487587.913878:0:192469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.913884:0:192469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487587.913901:0:192469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487587.913922:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.913933:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.913943:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.913951:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.913968:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487587.913973:0:192469:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+48:2361:x1869066294448512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 142us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487587.913980:0:192469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6530 00000100:00100000:2.0:1782487587.914167:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+203:3317:x1869066299314688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4617us (5030us total) trans 8589940883 rc 0/0 00000100:00100000:2.0:1782487587.914176:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16629 00010000:00010000:2.0:1782487587.914215:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487587.914221:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.914230:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487587.914235:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.914244:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.914258:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.914265:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aca4c55a/0x66475b4e8b85edac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487587.914284:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.914287:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487587.914290:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782487587.914315:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb97b80/2, rc 0, transno 8589940883 00000100:00100000:2.0:1782487587.914321:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299314688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782487588.227239:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487589.252225:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782487589.725770:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940858 is committed 00000001:00080000:3.0:1782487589.725844:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940882 is committed 00000001:00080000:3.0:1782487589.726058:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940682 is committed 00000001:00080000:3.0:1782487589.726070:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940670 is committed 00000001:00080000:3.0:1782487589.726134:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940883 is committed 00000001:00080000:3.0:1782487589.726390:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940687 is committed 00000001:00080000:3.0:1782487589.726563:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589940680 is committed 00000001:00080000:2.0:1782487590.232473:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940174 is committed 00000001:00080000:2.0:1782487590.232551:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940184 is committed 00000001:00080000:2.0:1782487590.232766:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940023 is committed 00000001:00080000:2.0:1782487590.232776:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940016 is committed 00000001:00080000:2.0:1782487590.233118:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940024 is committed 00010000:00010000:0.0:1782487590.274213:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487590.482842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.482889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.482920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.482993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487590.483261:0:190290:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448640 00000100:00100000:3.0:1782487590.483271:0:190290:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448640 00000100:00100000:0.0:1782487590.483271:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449024 00000100:00100000:0.0:1782487590.483278:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449024 00000100:00100000:0.0:1782487590.483331:0:213223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448896 00000100:00100000:3.0:1782487590.483335:0:190290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 332 00000100:00100000:0.0:1782487590.483336:0:213223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448896 00000100:00100000:3.0:1782487590.483350:0:190290:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2361:x1869066294448640:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487590.483366:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 255 00000100:00100000:0.0:1782487590.483376:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+10:2360:x1869066294449024:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487590.483424:0:190290:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2361:x1869066294448640:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487590.483425:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+10:2360:x1869066294449024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487590.483443:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 255 00000100:00100000:3.0:1782487590.483447:0:190290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 332 00000100:00100000:0.0:1782487590.483468:0:213223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 256 00000100:00100000:0.0:1782487590.483478:0:213223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2361:x1869066294448896:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487590.483504:0:213223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2361:x1869066294448896:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487590.483510:0:213223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 256 00000100:00100000:3.0:1782487590.483521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.483534:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294448768 00000100:00100000:0.0:1782487590.483538:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294448768 00000100:00100000:0.0:1782487590.483576:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 423 00000100:00100000:0.0:1782487590.483585:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294448768:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487590.483598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.483643:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294448768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 59us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487590.483653:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 423 00000100:00100000:0.0:1782487590.483677:0:213218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449152 00000100:00100000:3.0:1782487590.483682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487590.483682:0:213218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449152 00000100:00100000:1.0:1782487590.483711:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449280 00000100:00100000:1.0:1782487590.483716:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449280 00000100:00100000:0.0:1782487590.483716:0:213218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 424 00000100:00100000:0.0:1782487590.483725:0:213218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294449152:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1782487590.483748:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449408 00000100:00100000:1.0:1782487590.483751:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449408 00000100:00100000:0.0:1782487590.483757:0:213218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294449152:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487590.483774:0:213218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 424 00000100:00100000:1.0:1782487590.483785:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 257 00000100:00100000:1.0:1782487590.483794:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2360:x1869066294449280:12345-192.168.202.21@tcp:400:kworker.0 00000100:00080000:0.0:1782487590.483800:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782487590.483805:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782487590.483810:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782487590.483817:0:200304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 258 00000100:00100000:3.0:1782487590.483829:0:200304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+12:2361:x1869066294449408:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1782487590.483837:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2360:x1869066294449280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 43us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487590.483846:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 257 00000100:00100000:3.0:1782487590.483866:0:200304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5c4ca15f-f34e-4111-b105-de67ffe3ec92+12:2361:x1869066294449408:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487590.483875:0:200304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 258 00000100:00100000:2.0:1782487591.233716:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782487591.233743:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299314944:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.233744:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299315072:0@lo:400:kworker.0 00000100:00100000:2.0:1782487591.233825:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487591.233826:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487591.233855:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299315456:0@lo:400:kworker.0 00000100:00100000:2.0:1782487591.233894:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299315328:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.233896:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066299315584:0@lo:400:kworker.0 00000100:00100000:2.0:1782487591.233945:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299315200:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.233952:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315072 00000100:00100000:3.0:1782487591.233957:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487591.233961:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315072 00000100:00100000:2.0:1782487591.233988:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487591.234015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487591.234023:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315200 00000100:00100000:1.0:1782487591.234028:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315200 00000100:00100000:2.0:1782487591.234042:0:190292:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299314944 00000100:00100000:2.0:1782487591.234048:0:190292:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299314944 00000100:00100000:1.0:1782487591.234074:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1782487591.234083:0:213225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782487591.234088:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299315072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487591.234099:0:213225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299315200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782487591.234141:0:190292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782487591.234148:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299315072:12345-0@lo:400:kworker.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487591.234154:0:190292:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299314944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.234171:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1782487591.234171:0:213225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299315200:12345-0@lo:400:kworker.0 Request processed in 64us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487591.234183:0:213225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782487591.234205:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315456 00000100:00100000:1.0:1782487591.234210:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315456 00000100:00100000:2.0:1782487591.234219:0:190292:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299314944:12345-0@lo:400:kworker.0 Request processed in 70us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487591.234228:0:190292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1782487591.234231:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589940184 gen 2 00000100:00100000:1.0:1782487591.234243:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315328 00000100:00100000:1.0:1782487591.234248:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315328 00000004:00080000:0.0:1782487591.234255:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c09c00, transno 8589940025 00000004:00080000:0.0:1782487591.234270:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c0b800, transno 8589940026 00000004:00080000:0.0:1782487591.234276:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c0a300, transno 8589940027 00000004:00080000:0.0:1782487591.234280:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c0b480, transno 8589940028 00000004:00080000:0.0:1782487591.234284:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c08000, transno 8589940029 00000100:00100000:1.0:1782487591.234285:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000004:00080000:0.0:1782487591.234289:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c09180, transno 8589940030 00000004:00080000:0.0:1782487591.234294:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c08700, transno 8589940031 00000100:00100000:1.0:1782487591.234297:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299315456:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1782487591.234299:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb476c0bb80, transno 8589940032 00000004:00080000:0.0:1782487591.234306:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549183100, transno 8589940033 00000004:00080000:0.0:1782487591.234311:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df5880, transno 8589940034 00000004:00080000:0.0:1782487591.234316:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573532a00, transno 8589940035 00000100:00100000:3.0:1782487591.234317:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299314944:0@lo:400:kworker.0 00000004:00080000:0.0:1782487591.234321:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df5c00, transno 8589940036 00000004:00080000:0.0:1782487591.234328:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c47480, transno 8589940037 00000004:00080000:0.0:1782487591.234332:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549181c00, transno 8589940038 00000004:00080000:0.0:1782487591.234336:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb45036b480, transno 8589940039 00000004:00080000:0.0:1782487591.234341:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c46300, transno 8589940040 00000004:00080000:0.0:1782487591.234345:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c47800, transno 8589940041 00000100:00100000:1.0:1782487591.234351:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066299315456:12345-0@lo:400:kworker.0 Request processed in 55us (450us total) trans 0 rc 0/0 00000004:00080000:0.0:1782487591.234352:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c45500, transno 8589940042 00000004:00080000:0.0:1782487591.234358:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573530a80, transno 8589940043 00000100:00100000:1.0:1782487591.234364:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000004:00080000:0.0:1782487591.234364:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573530380, transno 8589940044 00000004:00080000:0.0:1782487591.234371:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573533800, transno 8589940045 00000004:00080000:0.0:1782487591.234375:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e5500, transno 8589940046 00000004:00080000:0.0:1782487591.234379:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e5c00, transno 8589940047 00000004:00080000:0.0:1782487591.234384:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4a80, transno 8589940048 00000100:00100000:1.0:1782487591.234386:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000004:00080000:0.0:1782487591.234390:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e6680, transno 8589940049 00000004:00080000:0.0:1782487591.234397:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491cb480, transno 8589940050 00000100:00100000:1.0:1782487591.234398:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299315328:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1782487591.234402:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c8000, transno 8589940051 00000004:00080000:0.0:1782487591.234408:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c8a80, transno 8589940052 00000004:00080000:0.0:1782487591.234412:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491cb100, transno 8589940053 00000004:00080000:0.0:1782487591.234416:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c8700, transno 8589940054 00000004:00080000:0.0:1782487591.234420:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547712680, transno 8589940055 00000004:00080000:0.0:1782487591.234424:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548847100, transno 8589940056 00000004:00080000:0.0:1782487591.234428:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547710700, transno 8589940057 00000004:00080000:0.0:1782487591.234431:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547711c00, transno 8589940058 00000004:00080000:0.0:1782487591.234435:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547712a00, transno 8589940059 00000004:00080000:0.0:1782487591.234438:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548847800, transno 8589940060 00000004:00080000:0.0:1782487591.234443:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549165f80, transno 8589940061 00000100:00100000:1.0:1782487591.234446:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066299315328:12345-0@lo:400:kworker.0 Request processed in 49us (430us total) trans 0 rc 0/0 00000004:00080000:0.0:1782487591.234448:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549165c00, transno 8589940062 00000004:00080000:0.0:1782487591.234455:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549165180, transno 8589940063 00000100:00100000:1.0:1782487591.234460:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000004:00080000:0.0:1782487591.234461:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549166d80, transno 8589940064 00000004:00080000:0.0:1782487591.234467:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549164e00, transno 8589940065 00000004:00080000:0.0:1782487591.234471:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549164000, transno 8589940066 00000004:00080000:0.0:1782487591.234476:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770ea00, transno 8589940067 00000004:00080000:0.0:1782487591.234479:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770c380, transno 8589940068 00000004:00080000:0.0:1782487591.234482:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770d500, transno 8589940069 00000100:00080000:1.0:1782487591.234485:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1782487591.234486:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770f800, transno 8589940070 00000100:00080000:1.0:1782487591.234493:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782487591.234493:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770e680, transno 8589940071 00000100:00080000:1.0:1782487591.234499:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1782487591.234499:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d79f80, transno 8589940072 00000004:00080000:0.0:1782487591.234506:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558775880, transno 8589940073 00000100:00100000:1.0:1782487591.234540:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066299315456:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.234567:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066299315328:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.234588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782487591.234633:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589940883 gen 2 00000004:00080000:1.0:1782487591.234663:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546d9a680, transno 8589940688 00000004:00080000:1.0:1782487591.234675:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491ac700, transno 8589940689 00000004:00080000:1.0:1782487591.234679:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c48a80, transno 8589940690 00000004:00080000:1.0:1782487591.234684:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491ace00, transno 8589940691 00000004:00080000:1.0:1782487591.234687:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4e5d54000, transno 8589940692 00000004:00080000:1.0:1782487591.234689:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c48380, transno 8589940693 00000004:00080000:1.0:1782487591.234692:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4e5d57100, transno 8589940694 00000004:00080000:1.0:1782487591.234695:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548e7ca80, transno 8589940695 00000004:00080000:1.0:1782487591.234697:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df7100, transno 8589940696 00000004:00080000:1.0:1782487591.234699:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c45880, transno 8589940697 00000004:00080000:1.0:1782487591.234701:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df4000, transno 8589940698 00000004:00080000:1.0:1782487591.234704:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c44e00, transno 8589940699 00000004:00080000:1.0:1782487591.234707:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c44700, transno 8589940700 00000004:00080000:1.0:1782487591.234709:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df4a80, transno 8589940701 00000004:00080000:1.0:1782487591.234711:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c47100, transno 8589940702 00000004:00080000:1.0:1782487591.234713:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df5f80, transno 8589940703 00000004:00080000:1.0:1782487591.234715:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c45c00, transno 8589940704 00000004:00080000:1.0:1782487591.234718:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c46a00, transno 8589940705 00000004:00080000:1.0:1782487591.234721:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e5880, transno 8589940706 00000004:00080000:1.0:1782487591.234723:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c45f80, transno 8589940707 00000004:00080000:1.0:1782487591.234725:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e6300, transno 8589940708 00000004:00080000:1.0:1782487591.234728:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e7800, transno 8589940709 00000004:00080000:1.0:1782487591.234730:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4000, transno 8589940710 00000004:00080000:1.0:1782487591.234732:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573530000, transno 8589940711 00000004:00080000:1.0:1782487591.234734:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491cbb80, transno 8589940712 00000004:00080000:1.0:1782487591.234737:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c9180, transno 8589940713 00000004:00080000:1.0:1782487591.234740:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c8e00, transno 8589940714 00000004:00080000:1.0:1782487591.234743:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547711500, transno 8589940715 00000004:00080000:1.0:1782487591.234746:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547712d80, transno 8589940716 00000004:00080000:1.0:1782487591.234748:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547711f80, transno 8589940717 00000004:00080000:1.0:1782487591.234751:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5491c9880, transno 8589940718 00000004:00080000:1.0:1782487591.234754:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547713480, transno 8589940719 00000004:00080000:1.0:1782487591.234756:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549166680, transno 8589940720 00000004:00080000:1.0:1782487591.234759:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549164700, transno 8589940721 00000004:00080000:1.0:1782487591.234761:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549166a00, transno 8589940722 00000004:00080000:1.0:1782487591.234764:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7a680, transno 8589940723 00000004:00080000:1.0:1782487591.234767:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d78700, transno 8589940724 00000004:00080000:1.0:1782487591.234769:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549165500, transno 8589940725 00000004:00080000:1.0:1782487591.234772:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7b100, transno 8589940726 00000004:00080000:1.0:1782487591.234774:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549167800, transno 8589940727 00000004:00080000:1.0:1782487591.234777:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770ce00, transno 8589940728 00000004:00080000:1.0:1782487591.234779:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547710380, transno 8589940729 00000004:00080000:1.0:1782487591.234781:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d79500, transno 8589940730 00000004:00080000:1.0:1782487591.234783:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770c700, transno 8589940731 00000004:00080000:1.0:1782487591.234786:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7b480, transno 8589940732 00000004:00080000:1.0:1782487591.234788:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434aa680, transno 8589940733 00000004:00080000:1.0:1782487591.234790:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558776300, transno 8589940734 00000004:00080000:1.0:1782487591.234793:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a9180, transno 8589940735 00000004:00080000:1.0:1782487591.234796:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558775c00, transno 8589940736 00000004:00080000:1.0:1782487591.234799:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a9c00, transno 8589940737 00000004:00080000:1.0:1782487591.234801:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7b800, transno 8589940738 00000004:00080000:1.0:1782487591.234804:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549181500, transno 8589940739 00000004:00080000:1.0:1782487591.234806:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558775180, transno 8589940740 00000004:00080000:1.0:1782487591.234809:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549181f80, transno 8589940741 00000004:00080000:1.0:1782487591.234812:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549180000, transno 8589940742 00000004:00080000:1.0:1782487591.234814:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558776a00, transno 8589940743 00000004:00080000:1.0:1782487591.234817:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e6d80, transno 8589940744 00000004:00080000:1.0:1782487591.234819:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549167b80, transno 8589940745 00000004:00080000:1.0:1782487591.234822:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549183480, transno 8589940746 00000004:00080000:1.0:1782487591.234824:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4700, transno 8589940747 00000004:00080000:1.0:1782487591.234826:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573531880, transno 8589940748 00000004:00080000:1.0:1782487591.234830:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548845c00, transno 8589940749 00000004:00080000:1.0:1782487591.234833:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547712300, transno 8589940750 00000004:00080000:1.0:1782487591.234836:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548844e00, transno 8589940751 00000004:00080000:1.0:1782487591.234838:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547713b80, transno 8589940752 00000004:00080000:1.0:1782487591.234841:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a8000, transno 8589940753 00000004:00080000:1.0:1782487591.234844:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573533480, transno 8589940754 00000004:00080000:1.0:1782487591.234848:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549164380, transno 8589940755 00000004:00080000:1.0:1782487591.234851:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d79880, transno 8589940756 00000004:00080000:1.0:1782487591.234854:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573531180, transno 8589940757 00000004:00080000:1.0:1782487591.234856:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb573531500, transno 8589940758 00000004:00080000:1.0:1782487591.234858:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547685500, transno 8589940759 00000004:00080000:1.0:1782487591.234862:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87c380, transno 8589940760 00000004:00080000:1.0:1782487591.234865:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547684700, transno 8589940761 00000004:00080000:1.0:1782487591.234869:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7a300, transno 8589940762 00000004:00080000:1.0:1782487591.234871:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547685f80, transno 8589940763 00000004:00080000:1.0:1782487591.234874:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87ca80, transno 8589940764 00000004:00080000:1.0:1782487591.234876:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87dc00, transno 8589940765 00000004:00080000:1.0:1782487591.234881:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434ab100, transno 8589940766 00000004:00080000:1.0:1782487591.234884:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87ea00, transno 8589940767 00000004:00080000:1.0:1782487591.234886:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547710a80, transno 8589940768 00000004:00080000:1.0:1782487591.234889:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434aad80, transno 8589940769 00000004:00080000:1.0:1782487591.234892:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549167480, transno 8589940770 00000004:00080000:1.0:1782487591.234894:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4e00, transno 8589940771 00000004:00080000:1.0:1782487591.234896:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549164a80, transno 8589940772 00000004:00080000:1.0:1782487591.234900:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb49058ed80, transno 8589940773 00000004:00080000:1.0:1782487591.234903:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb543520700, transno 8589940774 00000004:00080000:1.0:1782487591.234905:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44a0e6680, transno 8589940775 00000004:00080000:1.0:1782487591.234908:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb560a04a80, transno 8589940776 00000004:00080000:1.0:1782487591.234910:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44a0e6300, transno 8589940777 00000004:00080000:1.0:1782487591.234912:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb453dd0380, transno 8589940778 00000004:00080000:1.0:1782487591.234915:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df7800, transno 8589940779 00000004:00080000:1.0:1782487591.234917:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb453dd1c00, transno 8589940780 00000004:00080000:1.0:1782487591.234919:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44a0e6d80, transno 8589940781 00000004:00080000:1.0:1782487591.234921:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd6a00, transno 8589940782 00000004:00080000:1.0:1782487591.234924:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd5500, transno 8589940783 00000004:00080000:1.0:1782487591.234926:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44a0e5c00, transno 8589940784 00000004:00080000:1.0:1782487591.234928:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770ca80, transno 8589940785 00000004:00080000:1.0:1782487591.234930:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c3ad80, transno 8589940786 00000004:00080000:1.0:1782487591.234933:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd5180, transno 8589940787 00000004:00080000:1.0:1782487591.234936:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6bb80, transno 8589940788 00000004:00080000:1.0:1782487591.234939:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c5880, transno 8589940789 00000004:00080000:1.0:1782487591.234942:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d68380, transno 8589940790 00000004:00080000:1.0:1782487591.234945:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6ad80, transno 8589940791 00000004:00080000:1.0:1782487591.234948:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6b100, transno 8589940792 00000004:00080000:1.0:1782487591.234951:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6b800, transno 8589940793 00000004:00080000:1.0:1782487591.234955:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c6d80, transno 8589940794 00000004:00080000:1.0:1782487591.234958:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c6680, transno 8589940795 00000004:00080000:1.0:1782487591.234961:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c4380, transno 8589940796 00000004:00080000:1.0:1782487591.234963:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d69500, transno 8589940797 00000004:00080000:1.0:1782487591.234966:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f4700, transno 8589940798 00000004:00080000:1.0:1782487591.234969:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd7b80, transno 8589940799 00000004:00080000:1.0:1782487591.234972:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb453dd0700, transno 8589940800 00000004:00080000:1.0:1782487591.234974:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f7b80, transno 8589940801 00000004:00080000:1.0:1782487591.234976:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f7480, transno 8589940802 00000004:00080000:1.0:1782487591.234978:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f5c00, transno 8589940803 00000004:00080000:1.0:1782487591.234981:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfce00, transno 8589940804 00000004:00080000:1.0:1782487591.234983:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdffb80, transno 8589940805 00000004:00080000:1.0:1782487591.234986:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfd880, transno 8589940806 00000004:00080000:1.0:1782487591.234988:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdff100, transno 8589940807 00000004:00080000:1.0:1782487591.234990:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e6a00, transno 8589940808 00000004:00080000:1.0:1782487591.234993:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdff480, transno 8589940809 00000004:00080000:1.0:1782487591.234995:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f5180, transno 8589940810 00000004:00080000:1.0:1782487591.234997:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd5f80, transno 8589940811 00000004:00080000:1.0:1782487591.235000:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3f100, transno 8589940812 00000004:00080000:1.0:1782487591.235002:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3c000, transno 8589940813 00000004:00080000:1.0:1782487591.235005:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5600db100, transno 8589940814 00000004:00080000:1.0:1782487591.235008:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3d880, transno 8589940815 00000004:00080000:1.0:1782487591.235011:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d93100, transno 8589940816 00000004:00080000:1.0:1782487591.235015:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d92a00, transno 8589940817 00000004:00080000:1.0:1782487591.235017:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5600d9880, transno 8589940818 00000004:00080000:1.0:1782487591.235020:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d91880, transno 8589940819 00000004:00080000:1.0:1782487591.235022:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d92d80, transno 8589940820 00000004:00080000:1.0:1782487591.235025:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d92680, transno 8589940821 00000004:00080000:1.0:1782487591.235028:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3df80, transno 8589940822 00000004:00080000:1.0:1782487591.235031:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6a300, transno 8589940823 00000004:00080000:1.0:1782487591.235033:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb96300, transno 8589940824 00000004:00080000:1.0:1782487591.235035:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb96680, transno 8589940825 00000004:00080000:1.0:1782487591.235038:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb94700, transno 8589940826 00000004:00080000:1.0:1782487591.235041:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549181880, transno 8589940827 00000004:00080000:1.0:1782487591.235043:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb559179c00, transno 8589940828 00000004:00080000:1.0:1782487591.235045:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6aa00, transno 8589940829 00000004:00080000:1.0:1782487591.235048:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3c380, transno 8589940830 00000004:00080000:1.0:1782487591.235050:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3f800, transno 8589940831 00000004:00080000:1.0:1782487591.235052:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f7800, transno 8589940832 00000004:00080000:1.0:1782487591.235055:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df5180, transno 8589940833 00000004:00080000:1.0:1782487591.235058:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfed80, transno 8589940834 00000004:00080000:1.0:1782487591.235060:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfc700, transno 8589940835 00000004:00080000:1.0:1782487591.235064:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd4000, transno 8589940836 00000004:00080000:1.0:1782487591.235066:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb453dd2d80, transno 8589940837 00000004:00080000:1.0:1782487591.235069:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd6d80, transno 8589940838 00000004:00080000:1.0:1782487591.235071:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd5c00, transno 8589940839 00000004:00080000:1.0:1782487591.235074:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c7480, transno 8589940840 00000004:00080000:1.0:1782487591.235077:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee9c00, transno 8589940841 00000004:00080000:1.0:1782487591.235080:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee9f80, transno 8589940842 00000004:00080000:1.0:1782487591.235082:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eeb480, transno 8589940843 00000004:00080000:1.0:1782487591.235084:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eeb800, transno 8589940844 00000004:00080000:1.0:1782487591.235086:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee9880, transno 8589940845 00000004:00080000:1.0:1782487591.235089:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee8700, transno 8589940846 00000004:00080000:1.0:1782487591.235092:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c4700, transno 8589940847 00000004:00080000:1.0:1782487591.235095:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eeb100, transno 8589940848 00000004:00080000:1.0:1782487591.235097:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee8000, transno 8589940849 00000004:00080000:1.0:1782487591.235099:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb94380, transno 8589940850 00000004:00080000:1.0:1782487591.235101:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c5c00, transno 8589940851 00000004:00080000:1.0:1782487591.235103:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d91500, transno 8589940852 00000004:00080000:1.0:1782487591.235106:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c7b80, transno 8589940853 00000004:00080000:1.0:1782487591.235108:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c6a00, transno 8589940854 00000004:00080000:1.0:1782487591.235110:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c7800, transno 8589940855 00000004:00080000:1.0:1782487591.235113:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c4e00, transno 8589940856 00000004:00080000:1.0:1782487591.235115:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee8380, transno 8589940857 00000004:00080000:1.0:1782487591.235120:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c5f80, transno 8589940858 00000004:00080000:1.0:1782487591.235123:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c7100, transno 8589940859 00000004:00080000:1.0:1782487591.235127:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed6d80, transno 8589940860 00000004:00080000:1.0:1782487591.235130:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d90e00, transno 8589940861 00000004:00080000:1.0:1782487591.235132:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed6a00, transno 8589940862 00000004:00080000:1.0:1782487591.235134:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed5180, transno 8589940863 00000004:00080000:1.0:1782487591.235137:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed7480, transno 8589940864 00000004:00080000:1.0:1782487591.235139:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed4a80, transno 8589940865 00000004:00080000:1.0:1782487591.235143:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed4380, transno 8589940866 00000004:00080000:1.0:1782487591.235146:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb543521880, transno 8589940867 00000004:00080000:1.0:1782487591.235148:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed5500, transno 8589940868 00000004:00080000:1.0:1782487591.235151:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed6680, transno 8589940869 00000004:00080000:1.0:1782487591.235154:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549183800, transno 8589940870 00000004:00080000:1.0:1782487591.235170:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed7100, transno 8589940871 00000004:00080000:1.0:1782487591.235173:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eebb80, transno 8589940872 00000004:00080000:1.0:1782487591.235176:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee8e00, transno 8589940873 00000004:00080000:1.0:1782487591.235179:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee9180, transno 8589940874 00000004:00080000:1.0:1782487591.235182:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed5c00, transno 8589940875 00000004:00080000:1.0:1782487591.235184:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eea680, transno 8589940876 00000004:00080000:1.0:1782487591.235187:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d93800, transno 8589940877 00000004:00080000:1.0:1782487591.235190:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450ee9500, transno 8589940878 00000004:00080000:1.0:1782487591.235192:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb48eed7800, transno 8589940879 00000004:00080000:1.0:1782487591.235195:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb94a80, transno 8589940880 00000004:00080000:1.0:1782487591.235197:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb450eead80, transno 8589940881 00000004:00080000:1.0:1782487591.235200:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb97480, transno 8589940882 00000004:00080000:1.0:1782487591.235202:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb97b80, transno 8589940883 00000100:00100000:1.0:1782487591.235216:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299315072:0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.235247:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315584 00000100:00100000:1.0:1782487591.235251:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315584 00000100:00100000:1.0:1782487591.235287:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1782487591.235296:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066299315584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782487591.235333:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066299315584:12345-0@lo:400:kworker.0 Request processed in 39us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487591.235339:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:1.0:1782487591.235353:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782487591.235367:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066299315584:0@lo:400:kworker.0 00000004:00080000:3.0:1782487591.235516:0:190319:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 193 in progress, 0 in flight, 3 done 00000004:00080000:0.0:1782487591.236222:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770e300, transno 8589940074 00000004:00080000:0.0:1782487591.236229:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558774700, transno 8589940075 00000004:00080000:0.0:1782487591.236234:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549180a80, transno 8589940076 00000004:00080000:0.0:1782487591.236238:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549181180, transno 8589940077 00000004:00080000:0.0:1782487591.236242:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434ab800, transno 8589940078 00000004:00080000:0.0:1782487591.236246:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549180700, transno 8589940079 00000004:00080000:0.0:1782487591.236254:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558776680, transno 8589940080 00000004:00080000:0.0:1782487591.236259:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770ed80, transno 8589940081 00000004:00080000:0.0:1782487591.236262:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a8e00, transno 8589940082 00000004:00080000:0.0:1782487591.236267:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549183b80, transno 8589940083 00000004:00080000:0.0:1782487591.236271:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e4380, transno 8589940084 00000004:00080000:0.0:1782487591.236275:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549165880, transno 8589940085 00000004:00080000:0.0:1782487591.236278:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558776d80, transno 8589940086 00000004:00080000:0.0:1782487591.236281:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e7b80, transno 8589940087 00000004:00080000:0.0:1782487591.236285:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558774a80, transno 8589940088 00000004:00080000:0.0:1782487591.236288:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547710e00, transno 8589940089 00000004:00080000:0.0:1782487591.236291:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549167100, transno 8589940090 00000004:00080000:0.0:1782487591.236294:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547711880, transno 8589940091 00000004:00080000:0.0:1782487591.236297:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a8380, transno 8589940092 00000004:00080000:0.0:1782487591.236299:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558777b80, transno 8589940093 00000004:00080000:0.0:1782487591.236303:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558777480, transno 8589940094 00000004:00080000:0.0:1782487591.236307:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434ab480, transno 8589940095 00000004:00080000:0.0:1782487591.236310:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558777800, transno 8589940096 00000004:00080000:0.0:1782487591.236314:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d79180, transno 8589940097 00000004:00080000:0.0:1782487591.236317:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a8a80, transno 8589940098 00000004:00080000:0.0:1782487591.236320:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54770f100, transno 8589940099 00000004:00080000:0.0:1782487591.236323:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558775500, transno 8589940100 00000004:00080000:0.0:1782487591.236326:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d79c00, transno 8589940101 00000004:00080000:0.0:1782487591.236330:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d7ad80, transno 8589940102 00000004:00080000:0.0:1782487591.236333:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87ed80, transno 8589940103 00000004:00080000:0.0:1782487591.236338:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87d880, transno 8589940104 00000004:00080000:0.0:1782487591.236342:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87d180, transno 8589940105 00000004:00080000:0.0:1782487591.236344:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87f100, transno 8589940106 00000004:00080000:0.0:1782487591.236347:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87c700, transno 8589940107 00000004:00080000:0.0:1782487591.236350:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434a8700, transno 8589940108 00000004:00080000:0.0:1782487591.236354:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547687800, transno 8589940109 00000004:00080000:0.0:1782487591.236358:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549166300, transno 8589940110 00000004:00080000:0.0:1782487591.236362:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5434aaa00, transno 8589940111 00000004:00080000:0.0:1782487591.236366:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e7480, transno 8589940112 00000004:00080000:0.0:1782487591.236370:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549182a00, transno 8589940113 00000004:00080000:0.0:1782487591.236374:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549180e00, transno 8589940114 00000004:00080000:0.0:1782487591.236379:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549180380, transno 8589940115 00000004:00080000:0.0:1782487591.236384:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb54765ce00, transno 8589940116 00000004:00080000:0.0:1782487591.236389:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549182d80, transno 8589940117 00000004:00080000:0.0:1782487591.236393:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb56d87fb80, transno 8589940118 00000004:00080000:0.0:1782487591.236399:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb45a53f100, transno 8589940119 00000004:00080000:0.0:1782487591.236403:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df6a00, transno 8589940120 00000004:00080000:0.0:1782487591.236407:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df6680, transno 8589940121 00000004:00080000:0.0:1782487591.236412:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c38700, transno 8589940122 00000004:00080000:0.0:1782487591.236416:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb547684000, transno 8589940123 00000004:00080000:0.0:1782487591.236421:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df4380, transno 8589940124 00000004:00080000:0.0:1782487591.236424:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb546c3aa00, transno 8589940125 00000004:00080000:0.0:1782487591.236428:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4e5d54700, transno 8589940126 00000004:00080000:0.0:1782487591.236432:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd4700, transno 8589940127 00000004:00080000:0.0:1782487591.236437:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd6680, transno 8589940128 00000004:00080000:0.0:1782487591.236492:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd7800, transno 8589940129 00000004:00080000:0.0:1782487591.236497:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df6d80, transno 8589940130 00000004:00080000:0.0:1782487591.236501:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df7480, transno 8589940131 00000004:00080000:0.0:1782487591.236505:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44a0e5500, transno 8589940132 00000004:00080000:0.0:1782487591.236565:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd7480, transno 8589940133 00000004:00080000:0.0:1782487591.236571:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd4a80, transno 8589940134 00000004:00080000:0.0:1782487591.236575:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d68e00, transno 8589940135 00000004:00080000:0.0:1782487591.236579:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c4a80, transno 8589940136 00000004:00080000:0.0:1782487591.236583:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d68000, transno 8589940137 00000004:00080000:0.0:1782487591.236587:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd7100, transno 8589940138 00000004:00080000:0.0:1782487591.236590:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6b480, transno 8589940139 00000004:00080000:0.0:1782487591.236592:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c4000, transno 8589940140 00000004:00080000:0.0:1782487591.236596:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb46eabed80, transno 8589940141 00000004:00080000:0.0:1782487591.236599:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df5500, transno 8589940142 00000004:00080000:0.0:1782487591.236603:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f5500, transno 8589940143 00000004:00080000:0.0:1782487591.236623:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f6300, transno 8589940144 00000004:00080000:0.0:1782487591.236627:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e7100, transno 8589940145 00000004:00080000:0.0:1782487591.236631:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57f2c5180, transno 8589940146 00000004:00080000:0.0:1782487591.236635:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f4000, transno 8589940147 00000004:00080000:0.0:1782487591.236637:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f5f80, transno 8589940148 00000004:00080000:0.0:1782487591.236640:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f7100, transno 8589940149 00000004:00080000:0.0:1782487591.236643:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd5880, transno 8589940150 00000004:00080000:0.0:1782487591.236646:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfe680, transno 8589940151 00000004:00080000:0.0:1782487591.236650:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfdf80, transno 8589940152 00000004:00080000:0.0:1782487591.236654:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfe300, transno 8589940153 00000004:00080000:0.0:1782487591.236658:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfd180, transno 8589940154 00000004:00080000:0.0:1782487591.236663:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfca80, transno 8589940155 00000004:00080000:0.0:1782487591.236667:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfd500, transno 8589940156 00000004:00080000:3.0:1782487591.236673:0:190319:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 193 done 00000004:00080000:0.0:1782487591.236673:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb55afd4380, transno 8589940157 00000004:00080000:0.0:1782487591.236678:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3ca80, transno 8589940158 00000004:00080000:0.0:1782487591.236684:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb57fdfc000, transno 8589940159 00000004:00080000:0.0:1782487591.236687:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e5180, transno 8589940160 00000004:00080000:0.0:1782487591.236690:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d69f80, transno 8589940161 00000004:00080000:0.0:1782487591.236694:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549182680, transno 8589940162 00000004:00080000:0.0:1782487591.236699:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5600d9500, transno 8589940163 00000004:00080000:0.0:1782487591.236703:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d90000, transno 8589940164 00000004:00080000:0.0:1782487591.236706:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb4a1df4700, transno 8589940165 00000004:00080000:0.0:1782487591.236709:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d90a80, transno 8589940166 00000004:00080000:0.0:1782487591.236714:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d93480, transno 8589940167 00000004:00080000:0.0:1782487591.236717:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3d500, transno 8589940168 00000004:00080000:0.0:1782487591.236721:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb96a00, transno 8589940169 00000004:00080000:0.0:1782487591.236725:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb549182300, transno 8589940170 00000004:00080000:0.0:1782487591.236728:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3d180, transno 8589940171 00000004:00080000:0.0:1782487591.236733:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb95c00, transno 8589940172 00000004:00080000:0.0:1782487591.236736:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5589e5f80, transno 8589940173 00000004:00080000:0.0:1782487591.236739:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb95180, transno 8589940174 00000004:00080000:0.0:1782487591.236741:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f6d80, transno 8589940175 00000004:00080000:0.0:1782487591.236744:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f4e00, transno 8589940176 00000004:00080000:0.0:1782487591.236747:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3e300, transno 8589940177 00000004:00080000:0.0:1782487591.236751:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f5880, transno 8589940178 00000004:00080000:0.0:1782487591.236753:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb5492f4380, transno 8589940179 00000004:00080000:0.0:1782487591.236756:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb97800, transno 8589940180 00000004:00080000:0.0:1782487591.236758:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb543523100, transno 8589940181 00000004:00080000:0.0:1782487591.236761:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3e680, transno 8589940182 00000004:00080000:0.0:1782487591.236763:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb558a3f480, transno 8589940183 00000004:00080000:0.0:1782487591.236766:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb94000, transno 8589940184 00000100:00100000:0.0:1782487591.236780:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299315200:0@lo:400:kworker.0 00000004:00080000:1.0:1782487591.236822:0:190322:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7218658213896ns, next at 7219658211313ns, rc = 0 00000100:00100000:1.0:1782487591.236840:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487591.236851:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299315712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782487591.236889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487591.236923:0:190933:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315712 00000100:00100000:2.0:1782487591.236930:0:190933:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315712 00000100:00100000:2.0:1782487591.236976:0:190933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1782487591.236987:0:190933:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299315712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782487591.237015:0:190933:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3818913792 avail 3816816640 00000100:00100000:2.0:1782487591.237074:0:190933:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299315712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487591.237083:0:190933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1782487591.237087:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299315712:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1782487591.237931:0:190321:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 10 changes, 0 in progress, 0 in flight, 160 done 00010000:00010000:3.0:1782487591.297698:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487592.258762:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782487592.258784:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299315840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782487592.258843:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487592.258900:0:198596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315840 00000100:00100000:3.0:1782487592.258911:0:198596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315840 00000100:00100000:3.0:1782487592.258973:0:198596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782487592.258987:0:198596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299315840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782487592.259021:0:198596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3847225344 avail 3845128192 00000100:00100000:3.0:1782487592.259066:0:198596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299315840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487592.259073:0:198596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1782487592.259111:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299315840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782487592.321743:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782487592.786835:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000100:00100000:1.0:1782487592.786925:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299315968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487592.786987:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487592.787001:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299316352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787021:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299315968 00000100:00100000:3.0:1782487592.787029:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299315968 00000100:00100000:0.0:1782487592.787035:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487592.787062:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299316864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487592.787068:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299316480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787086:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316352 00000100:00100000:3.0:1782487592.787091:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316352 00000100:00100000:0.0:1782487592.787097:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487592.787101:0:213211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16630 00000100:00100000:1.0:1782487592.787102:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299316096:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487592.787121:0:213211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066299315968:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787124:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316864 00000100:00100000:3.0:1782487592.787129:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316864 00000100:00100000:1.0:1782487592.787140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487592.787167:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299316224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487592.787171:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299316608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787174:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316096 00000100:00100000:3.0:1782487592.787179:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316096 00002000:00080000:2.0:1782487592.787180:0:213211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6232 count 1 00000100:00100000:1.0:1782487592.787202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487592.787215:0:213224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316608 00010000:00010000:2.0:1782487592.787217:0:213211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.787221:0:213224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316608 00010000:00010000:2.0:1782487592.787244:0:213211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 11 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.787253:0:213224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16631 00010000:00010000:2.0:1782487592.787256:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1782487592.787261:0:213211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782487592.787263:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16632 00000100:00100000:3.0:1782487592.787266:0:213224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb576417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3316:x1869066299316352:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487592.787272:0:213211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787279:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3316:x1869066299316864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487592.787281:0:213224:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6228 count 1 00010000:00010000:3.0:1782487592.787298:0:213224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782487592.787302:0:213222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6234 count 1 00010000:00010000:3.0:1782487592.787322:0:213224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787322:0:213222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.787323:0:213211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 11 pid: 213221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787351:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782487592.787351:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 11 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.787358:0:213211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 11 pid: 213221 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787361:0:213224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.787372:0:213224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787372:0:213222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 11 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487592.787385:0:213211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299316992:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487592.787397:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1782487592.787402:0:213222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487592.787407:0:213222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787413:0:213224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787428:0:213224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787438:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 11 pid: 213223 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787460:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 11 pid: 213223 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.787463:0:213224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299317120:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487592.787463:0:213211:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782487592.787481:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299317248:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487592.787488:0:213213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16633 00000100:00100000:2.0:1782487592.787500:0:213213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3314:x1869066299316096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787501:0:213224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849f00 going to sleep for 11 seconds 00002000:00080000:2.0:1782487592.787517:0:213213:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6225 count 1 00000100:00100000:3.0:1782487592.787526:0:190930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16634 00010000:00010000:1.0:1782487592.787531:0:213222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 11 pid: 190931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.787540:0:190930:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3314:x1869066299316608:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487592.787544:0:213213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787547:0:213222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 11 pid: 190931 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487592.787557:0:190930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6231 count 1 00010000:00010000:2.0:1782487592.787571:0:213213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 9 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787573:0:213222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299317376:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487592.787574:0:190930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.787595:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1782487592.787599:0:213213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.787601:0:190930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 9 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787604:0:213222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447240 going to sleep for 11 seconds 00010000:00010000:2.0:1782487592.787626:0:213213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787650:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782487592.787655:0:190930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.787660:0:190930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.787666:0:213213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 9 pid: 195192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787671:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782487592.787690:0:213213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 9 pid: 195192 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787698:0:190930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 9 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787698:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299316736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487592.787705:0:213213:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299317504:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487592.787720:0:190930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 9 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.787733:0:190930:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299317632:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487592.787738:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487592.787753:0:213213:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782487592.787778:0:190930:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782487592.787783:0:192482:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316224 00000100:00100000:1.0:1782487592.787789:0:192482:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316224 00000100:00100000:3.0:1782487592.787800:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316736 00000100:00100000:3.0:1782487592.787805:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316736 00000100:00100000:1.0:1782487592.787825:0:192482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16635 00000100:00100000:1.0:1782487592.787835:0:192482:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3315:x1869066299316224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.787849:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16636 00002000:00080000:1.0:1782487592.787850:0:192482:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6229 count 1 00000100:00100000:3.0:1782487592.787863:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+11:3315:x1869066299316736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782487592.787866:0:192482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782487592.787878:0:213693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6235 count 1 00010000:00010000:1.0:1782487592.787881:0:192482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 9 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787891:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782487592.787894:0:213693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787895:0:192482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487592.787902:0:192482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787914:0:213693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 11 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787928:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782487592.787932:0:213693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.787937:0:213693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787940:0:192482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 9 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.787960:0:192482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 9 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.787972:0:213693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 11 pid: 213210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.787973:0:192482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299317760:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487592.787991:0:213693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 11 pid: 213210 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.788004:0:213693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299317888:192.168.202.21@tcp:104: 00000100:00100000:1.0:1782487592.788008:0:192482:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb453447a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782487592.788036:0:213693:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849600 going to sleep for 11 seconds 00000100:00100000:1.0:1782487592.788044:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487592.788063:0:213227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299316480 00000100:00100000:3.0:1782487592.788068:0:213227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299316480 00000100:00100000:3.0:1782487592.788104:0:213227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16637 00000100:00100000:3.0:1782487592.788114:0:213227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3317:x1869066299316480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782487592.788126:0:213227:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6230 count 1 00010000:00010000:3.0:1782487592.788138:0:213227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.788164:0:213227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 9 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.788172:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1782487592.788176:0:213227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.788180:0:213227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.788203:0:213227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 9 pid: 213222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.788215:0:213227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 9 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.788226:0:213227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299318016:192.168.202.21@tcp:104: 00000100:00100000:3.0:1782487592.788248:0:213227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb450849300 going to sleep for 11 seconds 00000100:00100000:1.0:1782487592.791637:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299317376:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487592.791700:0:213211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:213211:1869066299316992:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487592.791727:0:213211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.791750:0:213222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:213222:1869066299317248:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487592.791769:0:213213:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:213213:1869066299317504:192.168.202.21@tcp:104: 00010000:00010000:1.0:1782487592.791775:0:213222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.791788:0:213213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.791876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487592.791897:0:192482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:192482:1869066299317760:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487592.791917:0:192482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.791930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487592.791963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487592.791993:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450176 00000100:00100000:3.0:1782487592.791997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487592.792001:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450176 00000100:00100000:3.0:1782487592.792031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00080000:1.0:1782487592.792037:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782487592.792055:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 10 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.792067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487592.792095:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449664 00000100:00100000:0.0:1782487592.792101:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449664 00000100:00100000:3.0:1782487592.792102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00080000:1.0:1782487592.792127:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782487592.792132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487592.792137:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 12 pid: 213221 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792172:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449920 00000100:00100000:0.0:1782487592.792176:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449920 00010000:00010000:0.0:1782487592.792193:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 13 pid: 213223 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.792195:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487592.792221:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449536 00000100:00100000:0.0:1782487592.792225:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449536 00010000:00010000:0.0:1782487592.792238:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 14 pid: 190931 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792254:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450304 00000100:00100000:0.0:1782487592.792257:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450304 00010000:00010000:0.0:1782487592.792269:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 11 pid: 195192 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792285:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450560 00000100:00100000:0.0:1782487592.792296:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450560 00010000:00010000:0.0:1782487592.792309:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 12 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792324:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294449792 00000100:00100000:0.0:1782487592.792327:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294449792 00010000:00010000:0.0:1782487592.792338:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 13 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792352:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450048 00000100:00100000:0.0:1782487592.792354:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450048 00010000:00010000:0.0:1782487592.792365:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 14 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792379:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450432 00000100:00100000:0.0:1782487592.792382:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450432 00010000:00010000:0.0:1782487592.792394:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 15 pid: 213210 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792413:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6531 00000100:00100000:0.0:1782487592.792423:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+14:2362:x1869066294450176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487592.792432:0:213224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:213224:1869066299317120:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487592.792437:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.792446:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 14 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.792456:0:213224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792458:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 14 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792498:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d7442d/0x66475b4e8b85d804 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1855:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b9 expref: 14 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.792506:0:190930:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:190930:1869066299317632:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487592.792515:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.792521:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1855:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.792524:0:190930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792527:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792547:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792572:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487592.792574:0:213693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:213693:1869066299317888:192.168.202.21@tcp:104: 00010000:00010000:3.0:1782487592.792593:0:213693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792656:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+13:2362:x1869066294450176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 233us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487592.792667:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6531 00000100:00100000:0.0:1782487592.792689:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6532 00000100:00100000:0.0:1782487592.792699:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+15:2361:x1869066294449664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.792707:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.792713:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 15 pid: 213221 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792726:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 15 pid: 213221 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.792743:0:213227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:213227:1869066299318016:192.168.202.21@tcp:104: 00010000:00010000:0.0:1782487592.792744:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d0d2bdd/0x66475b4e8b85d8cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1858:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47820d expref: 15 pid: 213221 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792761:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.792762:0:213227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792767:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1858:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.792777:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792787:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.792798:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6533 00000100:00100000:3.0:1782487592.792809:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+14:2361:x1869066294449920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.792815:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782487592.792823:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782487592.792824:0:213211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.792833:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 14 pid: 213223 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.792839:0:213211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792845:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+14:2361:x1869066294449664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 144us (916us total) trans 0 rc 0/0 00010000:00010000:3.0:1782487592.792859:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 14 pid: 213223 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792865:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6532 00010000:00010000:2.0:1782487592.792866:0:213211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.792880:0:213211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.792887:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060ef439d/0x66475b4e8b85e245 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47848a expref: 13 pid: 213223 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.792895:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6534 00010000:00010000:2.0:1782487592.792906:0:213211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487592.792907:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+13:2360:x1869066294449536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.792918:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.792923:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 13 pid: 190931 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792934:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 13 pid: 190931 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792950:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08ec3fd/0x66475b4e8b85e21b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47849f expref: 13 pid: 190931 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792970:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.792975:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.792980:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.792988:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.792997:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782487592.793015:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782487592.793020:0:213222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.793025:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+11:2361:x1869066294449920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 216us (1060us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487592.793031:0:213222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.793040:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6533 00010000:00010000:1.0:1782487592.793041:0:213222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.793046:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+11:2360:x1869066294449536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 139us (1048us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487592.793055:0:213222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487592.793062:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6534 00000100:00100000:3.0:1782487592.793071:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6535 00010000:00010000:1.0:1782487592.793071:0:213222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782487592.793086:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb579991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+12:2361:x1869066294450304:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487592.793090:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6536 00010000:00010000:3.0:1782487592.793098:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782487592.793105:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+12:2363:x1869066294450560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487592.793107:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 12 pid: 195192 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793119:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487592.793124:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 12 pid: 195192 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793129:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 12 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793158:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 12 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.793161:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a39115/0x66475b4e8b85d45a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1851:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4780af expref: 12 pid: 195192 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793178:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6c7f703/0x66475b4e8b85d7fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1856:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781b2 expref: 12 pid: 213222 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.793186:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793189:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.793192:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1851:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793194:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1856:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.793201:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793201:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793213:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.793222:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793233:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487592.793259:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+10:2363:x1869066294450560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487592.793266:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6536 00000100:00100000:0.0:1782487592.793286:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6537 00000100:00100000:0.0:1782487592.793294:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+9:2360:x1869066294449792:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.793303:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.793309:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793317:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793328:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0592c3/0x66475b4e8b85d683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1854:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478149 expref: 9 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793336:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793338:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1854:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793341:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793346:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793361:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487592.793381:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+8:2360:x1869066294449792:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 89us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487592.793385:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6537 00000100:00100000:0.0:1782487592.793396:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6538 00000100:00100000:0.0:1782487592.793403:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+7:2360:x1869066294450048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.793410:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.793414:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793424:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793434:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f688f440/0x66475b4e8b85d866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1857:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a4781dc expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793441:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793443:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1857:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793446:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793451:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793464:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487592.793478:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:838f7623-bf1c-484f-8afd-fb26a1863ad0+6:2360:x1869066294450048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 77us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487592.793481:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6538 00000100:00100000:0.0:1782487592.793492:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6539 00000100:00100000:0.0:1782487592.793497:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+9:2360:x1869066294450432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487592.793503:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782487592.793506:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 9 pid: 213210 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793519:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 9 pid: 213210 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793527:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689a4885/0x66475b4e8b85e1f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478467 expref: 9 pid: 213210 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793533:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793536:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782487592.793539:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793543:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793556:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782487592.793573:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:2360:x1869066294450432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 76us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487592.793578:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6539 00000100:00100000:1.0:1782487592.793582:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3316:x1869066299316864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6308us (6487us total) trans 8589940185 rc 0/0 00000100:00100000:1.0:1782487592.793590:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16632 00000100:00100000:2.0:1782487592.793597:0:213211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3317:x1869066299315968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6481us (6607us total) trans 8589940186 rc 0/0 00010000:00010000:1.0:1782487592.793630:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782487592.793631:0:213211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16630 00010000:00010000:1.0:1782487592.793637:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.793644:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7600 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487592.793648:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.793655:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793660:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487592.793666:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793667:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.793687:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4c55a/0x66475b4e8b85edb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1858:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793688:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a9a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487592.793695:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793706:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.793714:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.793718:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487592.793719:0:213693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793721:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.793722:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487592.793737:0:213693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793741:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df7ebc74/0x66475b4e8b85edc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.793747:0:213693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782487592.793754:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847480/2, rc 0, transno 8589940185 00010000:00010000:0.0:1782487592.793756:0:213693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793762:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.793766:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487592.793770:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.793772:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299316864:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487592.793772:0:213693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782487592.793790:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487592.793794:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793802:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793813:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.793822:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e3d6a58/0x66475b4e8b85eddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.793830:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1782487592.793841:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487592.793842:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299318144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487592.793845:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.793849:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487592.793876:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487592.793878:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847100/2, rc 0, transno 8589940186 00000100:00100000:2.0:1782487592.793894:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299315968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782487592.793909:0:190931:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299318144 00000100:00100000:1.0:1782487592.793913:0:190931:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299318144 00010000:00010000:3.0:1782487592.793939:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782487592.793944:0:190931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16638 00000100:00100000:1.0:1782487592.793952:0:190931:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb545d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3316:x1869066299318144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782487592.793968:0:190931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6233 count 1 00000100:00100000:3.0:1782487592.793975:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb579991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2361:x1869066294450304:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 891us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487592.793984:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6535 00010000:00010000:1.0:1782487592.793985:0:190931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794001:0:213213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794001:0:190931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 7 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794020:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1782487592.794024:0:213213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794024:0:190931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782487592.794028:0:190931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794042:0:213213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794052:0:213213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794059:0:190931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 7 pid: 190928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794071:0:213213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487592.794076:0:190931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 7 pid: 190928 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.794091:0:190931:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb545d6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299318400:192.168.202.21@tcp:104: 00000100:00100000:0.0:1782487592.794102:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+14:3315:x1869066299316736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6241us (6364us total) trans 8589940187 rc 0/0 00000100:00100000:0.0:1782487592.794110:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16636 00010000:00010000:0.0:1782487592.794137:0:213229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487592.794154:0:213229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.794159:0:190931:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb4534476c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782487592.794167:0:213229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7400 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:0.0:1782487592.794171:0:213229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794181:0:213229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794196:0:213229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794204:0:213229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd53b040/0x66475b4e8b85edc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1851:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794231:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487592.794235:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487592.794240:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487592.794281:0:213227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794290:0:213227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794298:0:213227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794306:0:213227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.794326:0:213227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782487592.794332:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487592.794338:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794347:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487592.794351:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794360:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794374:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794382:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b372302/0x66475b4e8b85ede4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1856:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.794397:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.794399:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.794402:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487592.794466:0:213213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299316096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6967us (7324us total) trans 8589940188 rc 0/0 00000100:00100000:2.0:1782487592.794475:0:213213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16633 00000100:00100000:2.0:1782487592.794509:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299318272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782487592.794540:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782487592.794575:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548847800/2, rc 0, transno 8589940188 00000100:00100000:2.0:1782487592.794581:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299316096:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782487592.794642:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548844e00/2, rc 0, transno 8589940187 00000100:00100000:2.0:1782487592.794647:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299316736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487592.794666:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487592.794680:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299318272 00000100:00100000:2.0:1782487592.794683:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299318272 00000100:00100000:2.0:1782487592.794721:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16639 00000100:00100000:2.0:1782487592.794730:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3314:x1869066299318272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782487592.794745:0:213220:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:6236 count 1 00010000:00010000:2.0:1782487592.794759:0:213220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794773:0:213220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794786:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1782487592.794791:0:213220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782487592.794795:0:213220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794818:0:213220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.794830:0:213220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487592.794843:0:213220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299318528:192.168.202.21@tcp:104: 00000100:00100000:2.0:1782487592.794904:0:213220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9cb56fe84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782487592.795086:0:213227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+15:3317:x1869066299316480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6974us (7045us total) trans 8589940189 rc 0/0 00000100:00100000:0.0:1782487592.795094:0:213227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16637 00000004:00080000:2.0:1782487592.795100:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548844000/2, rc 0, transno 8589940189 00000100:00100000:2.0:1782487592.795108:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299316480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487592.795122:0:190930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795130:0:190930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795136:0:190930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795157:0:190930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795175:0:190930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782487592.795181:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487592.795188:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.795197:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691800 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487592.795202:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.795207:0:190931:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:190931:1869066299318400:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487592.795217:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795229:0:190931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.795232:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.795250:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021763c61/0x66475b4e8b85edcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1857:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.795271:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.795275:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.795278:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487592.795478:0:190930:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3314:x1869066299316608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7943us (8276us total) trans 8589940190 rc 0/0 00000100:00100000:0.0:1782487592.795485:0:190930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16634 00000004:00080000:2.0:1782487592.795493:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548845c00/2, rc 0, transno 8589940190 00000100:00100000:2.0:1782487592.795501:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299316608:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487592.795513:0:192482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795520:0:192482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795526:0:192482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795531:0:192482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795543:0:192482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782487592.795847:0:192482:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3315:x1869066299316224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8014us (8179us total) trans 8589940191 rc 0/0 00000100:00100000:0.0:1782487592.795854:0:192482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16635 00000004:00080000:2.0:1782487592.795862:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548846680/2, rc 0, transno 8589940191 00000100:00100000:2.0:1782487592.795871:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299316224:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487592.795885:0:213224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795895:0:213224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795902:0:213224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795906:0:213224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487592.795921:0:213224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782487592.795926:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487592.795932:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795938:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8e00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487592.795941:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795947:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795958:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795963:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ea92b92/0x66475b4e8b85edd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1855:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 192482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795978:0:190285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487592.795981:0:190285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795985:0:190285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690a00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487592.795988:0:190285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.795997:0:190285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.796005:0:190285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.796010:0:190285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6cc696f/0x66475b4e8b85edba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1854:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.796026:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.796029:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.796032:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487592.796285:0:213224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb576417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299316352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9022us (9249us total) trans 8589940192 rc 0/0 00000100:00100000:0.0:1782487592.796294:0:213224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16631 00000004:00080000:1.0:1782487592.796302:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb548845500/2, rc 0, transno 8589940192 00000100:00100000:1.0:1782487592.796310:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299316352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782487592.796445:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487592.800709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487592.800749:0:190282:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450688 00000100:00100000:3.0:1782487592.800757:0:190282:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450688 00010000:00010000:3.0:1782487592.800796:0:190282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 8 pid: 190928 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.800837:0:190282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6540 00000100:00100000:3.0:1782487592.800849:0:190282:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:2363:x1869066294450688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487592.800864:0:190282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487592.800871:0:190282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 8 pid: 190928 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.800893:0:190282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 8 pid: 190928 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.800926:0:190282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000890ab2c3/0x66475b4e8b85e206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1859:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a47847c expref: 8 pid: 190928 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.800941:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.800946:0:190282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1859:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.800953:0:190282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.800963:0:190282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801008:0:190931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801020:0:190931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801031:0:190931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801039:0:190931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801066:0:190931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782487592.801090:0:190282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782487592.801159:0:190282:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2363:x1869066294450688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 300us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487592.801168:0:190282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6540 00000100:00100000:2.0:1782487592.801286:0:213220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:213220:1869066299318528:192.168.202.21@tcp:104: 00010000:00010000:2.0:1782487592.801311:0:213220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487592.801654:0:190931:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb545d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3316:x1869066299318144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7702us (7777us total) trans 8589940193 rc 0/0 00000100:00100000:1.0:1782487592.801662:0:190931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16638 00010000:00010000:1.0:1782487592.801690:0:191970:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487592.801696:0:191970:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801706:0:191970:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4543a8200 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:1.0:1782487592.801711:0:191970:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801722:0:191970:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801735:0:191970:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801740:0:191970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b82e59c8/0x66475b4e8b85edeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1859:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 190931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487592.801759:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.801761:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487592.801764:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782487592.801797:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb545d6b480/2, rc 0, transno 8589940193 00000100:00100000:1.0:1782487592.801805:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb545d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299318144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782487592.802363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487592.802392:0:190283:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450816 00000100:00100000:3.0:1782487592.802398:0:190283:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450816 00010000:00010000:3.0:1782487592.802423:0:190283:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487592.802454:0:190283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6541 00000100:00100000:3.0:1782487592.802465:0:190283:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2360:x1869066294450816:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487592.802477:0:190283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782487592.802484:0:190283:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.802498:0:190283:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.802517:0:190283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005422f517/0x66475b4e8b85e214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.21@tcp remote: 0x43f633357a478491 expref: 7 pid: 192482 timeout: 7320 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.802531:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.802536:0:190283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x185c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782487592.802542:0:190283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.802551:0:190283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487592.802579:0:190283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782487592.802587:0:213220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.802599:0:213220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.802634:0:213220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.802643:0:213220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.802661:0:213220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782487592.802936:0:190283:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2360:x1869066294450816:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 471us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487592.802946:0:190283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6541 00000100:00100000:2.0:1782487592.803118:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3314:x1869066299318272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8388us (8576us total) trans 8589940194 rc 0/0 00000100:00100000:2.0:1782487592.803129:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16639 00000004:00080000:3.0:1782487592.803160:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cb44fb96d80/2, rc 0, transno 8589940194 00010000:00010000:2.0:1782487592.803166:0:190286:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782487592.803168:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299318272:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782487592.803173:0:190286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.803184:0:190286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4548c7c00 already unused, calling callback (ffffffffc1792ce0) 00010000:00010000:2.0:1782487592.803188:0:190286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.803198:0:190286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.803209:0:190286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.803214:0:190286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e438c25/0x66475b4e8b85edf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x185c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 213220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487592.803237:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.803241:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487592.803244:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487593.346194:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487594.369739:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782487595.348576:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940192 is committed 00000001:00080000:2.0:1782487595.348638:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940193 is committed 00000001:00080000:2.0:1782487595.348667:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940194 is committed 00010000:00010000:0.0:1782487595.393700:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487595.602429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487595.602478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487595.602497:0:190291:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294450944 00000100:00100000:0.0:1782487595.602507:0:190291:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294450944 00000100:00100000:3.0:1782487595.602512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487595.602546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487595.602567:0:190291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 334 00000100:00100000:0.0:1782487595.602577:0:190291:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2360:x1869066294450944:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487595.602579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487595.602622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487595.602695:0:190291:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2360:x1869066294450944:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 118us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487595.602703:0:190291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 334 00000100:00100000:3.0:1782487595.602722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1782487595.602874:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451072 00000100:00100000:3.0:1782487595.602879:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451072 00000100:00080000:0.0:1782487595.602931:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487595.602949:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451456 00000100:00100000:3.0:1782487595.602953:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451456 00000100:00080000:0.0:1782487595.602987:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782487595.602997:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 428 00000100:00100000:3.0:1782487595.603008:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294451072:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1782487595.603010:0:213684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 429 00000100:00100000:1.0:1782487595.603026:0:213684:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294451456:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487595.603065:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294451072:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 58us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487595.603066:0:213684:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294451456:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487595.603084:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 428 00000100:00100000:1.0:1782487595.603091:0:213684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 429 00000100:00100000:3.0:1782487595.603139:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451200 00000100:00100000:3.0:1782487595.603143:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451200 00000100:00100000:3.0:1782487595.603186:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451328 00000100:00100000:3.0:1782487595.603190:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451328 00000100:00100000:3.0:1782487595.603217:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451584 00000100:00100000:3.0:1782487595.603220:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451584 00000100:00100000:3.0:1782487595.603247:0:213228:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451712 00000100:00100000:3.0:1782487595.603250:0:213228:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451712 00000100:00100000:3.0:1782487595.603292:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 261 00000100:00100000:3.0:1782487595.603303:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2360:x1869066294451200:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487595.603312:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 262 00000100:00100000:0.0:1782487595.603323:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2361:x1869066294451328:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487595.603357:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2361:x1869066294451328:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 37us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487595.603363:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 262 00000100:00100000:3.0:1782487595.603381:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2360:x1869066294451200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487595.603381:0:213226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 263 00000100:00100000:0.0:1782487595.603392:0:213226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2361:x1869066294451584:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487595.603396:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 261 00000100:00100000:3.0:1782487595.603422:0:213228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 264 00000100:00100000:0.0:1782487595.603423:0:213226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2361:x1869066294451584:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487595.603432:0:213226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 263 00000100:00100000:3.0:1782487595.603437:0:213228:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2360:x1869066294451712:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1782487595.603471:0:213228:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2360:x1869066294451712:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487595.603479:0:213228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 264 00000100:00080000:0.0:1782487595.603580:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487595.603584:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782487596.353848:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299318784:0@lo:400:kworker.0 00000100:00100000:3.0:1782487596.353875:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299318656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782487596.353962:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487596.353991:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487596.354059:0:190933:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299318656 00000100:00100000:1.0:1782487596.354065:0:190292:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299318784 00000100:00100000:2.0:1782487596.354068:0:190933:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299318656 00000100:00100000:1.0:1782487596.354072:0:190292:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299318784 00000100:00100000:1.0:1782487596.354136:0:190292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1782487596.354148:0:190292:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.354154:0:190933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782487596.354166:0:190933:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299318656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782487596.354206:0:190933:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3818913792 avail 3816816640 00000100:00100000:1.0:1782487596.354224:0:190292:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6385baa4-edbe-4eae-af92-80250729af95+19:3316:x1869066299318784:12345-0@lo:400:kworker.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782487596.354233:0:190292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1782487596.354256:0:190933:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299318656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487596.354263:0:190933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782487596.354297:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299318912:0@lo:400:kworker.0 00000100:00100000:1.0:1782487596.354298:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6385baa4-edbe-4eae-af92-80250729af95:3316:1869066299318784:0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.354333:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487596.354349:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589940194 gen 2 00000004:00080000:3.0:1782487596.354356:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548847480, transno 8589940185 00000004:00080000:3.0:1782487596.354370:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548847100, transno 8589940186 00000100:00100000:2.0:1782487596.354372:0:213222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299318912 00000004:00080000:3.0:1782487596.354375:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548844e00, transno 8589940187 00000100:00100000:2.0:1782487596.354377:0:213222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299318912 00000004:00080000:3.0:1782487596.354381:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548847800, transno 8589940188 00000004:00080000:3.0:1782487596.354387:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548844000, transno 8589940189 00000004:00080000:3.0:1782487596.354391:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548845c00, transno 8589940190 00000004:00080000:3.0:1782487596.354396:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548846680, transno 8589940191 00000004:00080000:3.0:1782487596.354400:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb548845500, transno 8589940192 00000004:00080000:3.0:1782487596.354404:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb545d6b480, transno 8589940193 00000004:00080000:3.0:1782487596.354409:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cb44fb96d80, transno 8589940194 00000100:00100000:3.0:1782487596.354421:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299318656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782487596.354438:0:213222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782487596.354443:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782487596.354448:0:213222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299318912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487596.354454:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066299319040:0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.354492:0:213222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299318912:12345-0@lo:400:kworker.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487596.354500:0:213222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782487596.354511:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487596.354564:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319040 00000100:00100000:3.0:1782487596.354568:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319040 00000100:00100000:3.0:1782487596.354646:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1782487596.354657:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066299319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487596.354705:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066299319040:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487596.354712:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1782487596.354769:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066299319040:0@lo:400:kworker.0 00000004:00080000:2.0:1782487596.354838:0:190321:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00080000:2.0:1782487596.354866:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782487596.354869:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782487596.354891:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299318912:0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.357229:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066299319168:0@lo:400:kworker.0 00000100:00100000:0.0:1782487596.357245:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066299319296:0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.357275:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487596.357312:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319168 00000100:00100000:0.0:1782487596.357317:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319168 00000100:00080000:2.0:1782487596.357359:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782487596.357365:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1782487596.357374:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066299319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487596.357435:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066299319168:12345-0@lo:400:kworker.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487596.357443:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1782487596.357462:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066299319168:0@lo:400:kworker.0 00000100:00100000:0.0:1782487596.357471:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487596.357503:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319296 00000100:00100000:2.0:1782487596.357507:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319296 00000100:00080000:0.0:1782487596.357532:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782487596.357544:0:190298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1782487596.357550:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066299319296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782487596.357592:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066299319296:12345-0@lo:400:kworker.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487596.357599:0:190298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1782487596.357661:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066299319296:0@lo:400:kworker.0 00010000:00010000:2.0:1782487596.417738:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487597.377789:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb44fb97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299319424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782487597.377868:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487597.377968:0:198596:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319424 00000100:00100000:0.0:1782487597.377976:0:198596:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319424 00000100:00100000:0.0:1782487597.378026:0:198596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782487597.378035:0:198596:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299319424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782487597.378069:0:198596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3847225344 avail 3845128192 00000100:00100000:0.0:1782487597.378129:0:198596:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066299319424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487597.378137:0:198596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782487597.378167:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb44fb97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869066299319424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782487597.441736:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487598.465707:0:213229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487598.674469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487598.674652:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451840 00000100:00100000:0.0:1782487598.674661:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451840 00000100:00100000:0.0:1782487598.674722:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1166 00000100:00100000:0.0:1782487598.674733:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294451840:12345-192.168.202.21@tcp:63:ll_sa.0 00000100:00100000:3.0:1782487598.674761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1782487598.674769:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487598.674789:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85edf9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784f3 expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487598.674797:0:213217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294451968 00000100:00100000:3.0:1782487598.674803:0:213217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294451968 00010000:00010000:0.0:1782487598.674841:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487598.674852:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1167 00000100:00100000:3.0:1782487598.674864:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2363:x1869066294451968:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487598.674876:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674885:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487598.674892:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674900:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a4784fa expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.674920:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.674931:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.674944:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674950:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674962:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674972:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.674984:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675000:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675013:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675299:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675308:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675315:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675323:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de690e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487598.675329:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675337:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675350:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487598.675354:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487598.675359:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675365:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de690e00/0x66475b4e8b85ee15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675379:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675386:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675393:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675399:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb4de691c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1782487598.675403:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675411:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675421:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862100) 00010000:00010000:3.0:1782487598.675424:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782487598.675428:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675435:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691c00/0x66475b4e8b85ee1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675460:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee07 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784fa expref: 552 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675471:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:3.0:1782487598.675475:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782487598.675479:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb4de691400/0x66475b4e8b85ee07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784fa expref: 552 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487598.675490:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb4de691400, rc -2) 00000100:00100000:3.0:1782487598.675549:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2363:x1869066294451968:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 688us (789us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782487598.675561:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1167 00010000:00010000:0.0:1782487598.677185:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677195:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677202:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677208:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487598.677213:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677220:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677233:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487598.677236:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487598.677241:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677248:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fc00/0x66475b4e8b85ee00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677261:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677268:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677275:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677282:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487598.677286:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677293:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677302:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862100) 00010000:00010000:0.0:1782487598.677305:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487598.677308:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677314:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677345:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85edf9 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784f3 expref: 68 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677356:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487598.677358:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487598.677364:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85edf9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a4784f3 expref: 68 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487598.677373:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e200, rc -2) 00000100:00100000:0.0:1782487598.677417:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2361:x1869066294451840:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 2686us (2958us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487598.677429:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1166 00010000:00010000:3.0:1782487599.490720:0:191970:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487599.698380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487599.698454:0:190302:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452096 00000100:00100000:0.0:1782487599.698465:0:190302:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452096 00000100:00100000:0.0:1782487599.698535:0:190302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1168 00000100:00100000:0.0:1782487599.698558:0:190302:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb549167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294452096:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487599.698597:0:190302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487599.698628:0:190302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ee23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478501 expref: -99 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698675:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698687:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698698:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698710:0:190302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698715:0:190302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698720:0:190302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698988:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.698997:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699002:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699006:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487599.699010:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699017:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699034:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487599.699037:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487599.699043:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699050:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee2a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699064:0:190302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699071:0:190302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699077:0:190302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699096:0:190302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487599.699101:0:190302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699108:0:190302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699118:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487599.699122:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487599.699126:0:190302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699131:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699160:0:190302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ee23 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478501 expref: 552 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699168:0:190302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487599.699171:0:190302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487599.699175:0:190302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f000/0x66475b4e8b85ee23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478501 expref: 552 pid: 190302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487599.699185:0:190302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f000, rc -2) 00000100:00100000:0.0:1782487599.699354:0:190302:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb549167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2360:x1869066294452096:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 805us (983us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487599.699363:0:190302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1168 00010000:00010000:3.0:1782487600.515597:0:190286:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487600.723748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487600.725403:0:190290:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452352 00000100:00100000:0.0:1782487600.725412:0:190290:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452352 00000100:00100000:0.0:1782487600.725465:0:190290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 336 00000100:00100000:0.0:1782487600.725475:0:190290:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2363:x1869066294452352:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.725545:0:190290:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60894528-77cf-40cf-92ce-b54cc4bbae30+13:2363:x1869066294452352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.725553:0:190290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 336 00000100:00100000:0.0:1782487600.725592:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452608 00000100:00100000:0.0:1782487600.725595:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452608 00000100:00100000:0.0:1782487600.725685:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453120 00000100:00100000:0.0:1782487600.725689:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453120 00000100:00100000:0.0:1782487600.725714:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452736 00000100:00100000:0.0:1782487600.725717:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452736 00000100:00100000:0.0:1782487600.725744:0:213693:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452992 00000100:00100000:0.0:1782487600.725747:0:213693:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452992 00000100:00100000:0.0:1782487600.725774:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 266 00000100:00100000:0.0:1782487600.725782:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294452608:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.725814:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294452608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.725823:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 266 00000100:00100000:0.0:1782487600.725842:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 267 00000100:00100000:0.0:1782487600.725850:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2363:x1869066294453120:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.725879:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:2363:x1869066294453120:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.725886:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 267 00000100:00100000:0.0:1782487600.725903:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 268 00000100:00100000:0.0:1782487600.725911:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294452736:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.725935:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:838f7623-bf1c-484f-8afd-fb26a1863ad0+5:2363:x1869066294452736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.725942:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 268 00000100:00100000:0.0:1782487600.725958:0:213693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 269 00000100:00100000:0.0:1782487600.725965:0:213693:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2363:x1869066294452992:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.725989:0:213693:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:2363:x1869066294452992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.725996:0:213693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 269 00000100:00100000:0.0:1782487600.726020:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452864 00000100:00100000:0.0:1782487600.726024:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452864 00000100:00100000:0.0:1782487600.726054:0:196437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452480 00000100:00100000:0.0:1782487600.726058:0:196437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452480 00000100:00100000:0.0:1782487600.726097:0:196437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 433 00000100:00100000:0.0:1782487600.726106:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2363:x1869066294452864:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.726138:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2363:x1869066294452864:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 34us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.726146:0:196437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 433 00000100:00100000:0.0:1782487600.726163:0:196437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 434 00000100:00100000:0.0:1782487600.726170:0:196437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294452480:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1782487600.726198:0:196437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294452480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 28us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487600.726205:0:196437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 434 00000100:00080000:0.0:1782487600.726255:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782487600.726260:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782487600.726263:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487600.730365:0:213491:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294452224 00000100:00100000:3.0:1782487600.730379:0:213491:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294452224 00000100:00100000:0.0:1782487600.730484:0:213217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1169 00000100:00100000:0.0:1782487600.730497:0:213217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294452224:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487600.730543:0:213217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487600.730563:0:213217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee38 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a478508 expref: -99 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730630:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730645:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730658:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730673:0:213217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730691:0:213217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730698:0:213217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730990:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.730999:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731005:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731011:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487600.731015:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731022:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731034:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487600.731037:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487600.731041:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731047:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3ec00/0x66475b4e8b85ee3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731072:0:213217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731090:0:213217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731096:0:213217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731101:0:213217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487600.731104:0:213217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731110:0:213217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731117:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487600.731119:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487600.731122:0:213217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731127:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e800/0x66475b4e8b85ee46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731157:0:213217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee38 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478508 expref: 68 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731166:0:213217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487600.731168:0:213217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487600.731172:0:213217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3f400/0x66475b4e8b85ee38 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a478508 expref: 68 pid: 213217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487600.731181:0:213217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3f400, rc -2) 00000100:00100000:0.0:1782487600.731244:0:213217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:838f7623-bf1c-484f-8afd-fb26a1863ad0+67:2363:x1869066294452224:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 751us (7507us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487600.732041:0:213217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1169 00000100:00100000:0.0:1782487601.473785:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299319808:0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.473810:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299319936:0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.473852:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066299320064:0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.473852:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487601.473915:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6385baa4-edbe-4eae-af92-80250729af95:3314:1869066299319680:0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.473960:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487601.474016:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782487601.474062:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319808 00000100:00100000:3.0:1782487601.474080:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319808 00000100:00100000:3.0:1782487601.474139:0:213220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319936 00000100:00100000:3.0:1782487601.474142:0:213220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319936 00000100:00100000:3.0:1782487601.474167:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782487601.474178:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299319808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.474224:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066299319808:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487601.474229:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782487601.474246:0:213220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782487601.474252:0:213220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299319936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.474279:0:213220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066299319936:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487601.474284:0:213220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1782487601.474298:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782487601.474302:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782487601.474338:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869066299319936:0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.474376:0:190298:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320064 00000100:00100000:3.0:1782487601.474378:0:190298:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320064 00000100:00100000:3.0:1782487601.474401:0:190298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1782487601.474406:0:190298:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066299320064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782487601.474434:0:190298:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066299320064:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487601.474439:0:190298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1782487601.474471:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066299320064:0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.476131:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869066299319808:0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.476148:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299320320:0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.476173:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782487601.476208:0:190296:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320320 00000100:00100000:0.0:1782487601.476211:0:190296:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320320 00000100:00100000:0.0:1782487601.476240:0:190296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1782487601.476246:0:190296:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299320320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.476279:0:190296:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066299320320:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487601.476284:0:190296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:0.0:1782487601.476304:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782487601.476327:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066299320320:0@lo:400:kworker.0 00000100:00100000:2.0:1782487601.476670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487601.476714:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299319552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782487601.476746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487601.476768:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066299320192:0@lo:400:kworker.0 00000100:00100000:2.0:1782487601.476794:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782487601.476848:0:190932:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319552 00000100:00100000:2.0:1782487601.476853:0:190932:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319552 00000100:00100000:2.0:1782487601.476883:0:190932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782487601.476892:0:190932:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299319552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782487601.476921:0:190932:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 37158912 pending 0 free 3818913792 avail 3816816640 00000100:00100000:2.0:1782487601.476964:0:190932:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066299319552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487601.476971:0:190932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782487601.476995:0:213935:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320192 00000100:00100000:2.0:1782487601.476999:0:213935:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320192 00000100:00100000:2.0:1782487601.477035:0:213935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1782487601.477043:0:213935:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb44fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869066299320192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782487601.477095:0:213935:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb44fb95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869066299320192:12345-0@lo:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487601.477102:0:213935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1782487601.477112:0:190291:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299319680 00000100:00100000:0.0:1782487601.477118:0:190291:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299319680 00000100:00080000:2.0:1782487601.477131:0:190293:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782487601.477155:0:190291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1782487601.477164:0:190291:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb57f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6385baa4-edbe-4eae-af92-80250729af95+19:3314:x1869066299319680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782487601.477174:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869066299319552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782487601.477193:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb548e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066299320192:0@lo:400:kworker.0 00000100:00100000:0.0:1782487601.477205:0:190291:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb57f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6385baa4-edbe-4eae-af92-80250729af95+19:3314:x1869066299319680:12345-0@lo:400:kworker.0 Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782487601.477213:0:190291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782487601.477230:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9cb549164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6385baa4-edbe-4eae-af92-80250729af95:3314:1869066299319680:0@lo:400:kworker.0 00010000:00010000:2.0:1782487601.537701:0:190285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782487601.555270:0:216317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77r: @@@@@@ FAIL: timeout to start 'tbf uid' policy 00000100:00100000:0.0:1782487601.748512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1782487601.748553:0:213216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066294453248 00000100:00100000:0.0:1782487601.748563:0:213216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066294453248 00000100:00100000:0.0:1782487601.748683:0:213216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1170 00000100:00100000:0.0:1782487601.748696:0:213216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9cb548845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294453248:12345-192.168.202.21@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487601.748744:0:213216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782487601.748763:0:213216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43f633357a47850f expref: -99 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748815:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748830:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748843:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748860:0:213216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748868:0:213216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.748876:0:213216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749189:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749198:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749205:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749212:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487601.749217:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749225:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749239:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487601.749243:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487601.749247:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749254:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e200/0x66475b4e8b85ee54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749266:0:213216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749272:0:213216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749278:0:213216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749283:0:213216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb47ae3fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1782487601.749287:0:213216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749294:0:213216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749303:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x141795a8 (ffff9cb4c4862a00) 00010000:00010000:0.0:1782487601.749306:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782487601.749310:0:213216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749316:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3fe00/0x66475b4e8b85ee5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x141795a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 213216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749348:0:213216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee4d lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47850f expref: 552 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749359:0:213216:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x35:0x0].0x0 (ffff9cb5517d5e00) 00010000:00010000:0.0:1782487601.749361:0:213216:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782487601.749366:0:213216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb47ae3e600/0x66475b4e8b85ee4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x43f633357a47850f expref: 552 pid: 213216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487601.749376:0:213216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb47ae3e600, rc -2) 00000100:00100000:0.0:1782487601.749440:0:213216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9cb548845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+551:2361:x1869066294453248:12345-192.168.202.21@tcp:63:ll_sa.0 Request processed in 747us (937us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782487601.749449:0:213216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1170 Debug log: 59143 lines, 59143 kept, 0 dropped, 0 bad.